Sep 16 14:12:21.746171 ip-10-0-132-137 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 14:12:21.746184 ip-10-0-132-137 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 14:12:21.746193 ip-10-0-132-137 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 14:12:21.746394 ip-10-0-132-137 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 14:12:31.995491 ip-10-0-132-137 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 14:12:31.995510 ip-10-0-132-137 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot efb1b32915b14d74a8783b35de0a3b48 --
Sep 16 14:14:38.895766 ip-10-0-132-137 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 14:14:39.260525 ip-10-0-132-137 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 14:14:39.260525 ip-10-0-132-137 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 14:14:39.260525 ip-10-0-132-137 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 14:14:39.260525 ip-10-0-132-137 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 14:14:39.260525 ip-10-0-132-137 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 14:14:39.262856 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.262766    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 14:14:39.266351 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266336    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:14:39.266351 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266351    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266357    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266361    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266364    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266367    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266370    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266373    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266375    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266378    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266381    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266383    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266386    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266389    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266391    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266394    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266396    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266399    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266401    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266404    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:14:39.266411 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266411    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266414    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266418    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266422    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266425    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266428    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266431    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266434    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266436    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266439    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266442    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266446    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266462    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266465    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266468    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266471    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266474    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266477    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266480    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:14:39.266883 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266482    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266485    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266488    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266490    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266493    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266495    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266498    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266500    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266503    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266506    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266508    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266510    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266513    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266515    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266519    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266522    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266524    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266527    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266530    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266532    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:14:39.267382 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266535    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266537    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266540    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266543    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266545    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266548    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266550    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266553    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266555    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266558    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266561    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266564    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266567    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266569    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266572    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266575    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266577    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266580    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266583    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266585    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:14:39.267885 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266588    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266591    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266594    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266596    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266599    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266601    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266604    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266606    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266609    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266611    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266614    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266617    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266619    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266622    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266624    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266626    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266629    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266632    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266634    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.266637    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:14:39.268391 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267333    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267341    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267344    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267347    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267350    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267353    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267356    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267358    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267361    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267363    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267366    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267368    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267371    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267374    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267377    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267379    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267382    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267385    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267387    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267391    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:14:39.268896 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267393    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267396    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267399    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267401    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267404    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267406    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267409    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267411    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267414    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267416    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267419    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267421    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267423    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267426    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267428    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267431    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267433    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267436    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267439    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:14:39.269405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267442    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267445    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267464    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267467    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267471    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267475    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267478    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267481    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267484    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267487    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267490    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267492    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267495    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267497    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267500    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267502    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267505    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267507    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267511    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:14:39.269884 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267513    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267516    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267518    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267521    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267523    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267525    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267529    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267532    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267535    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267538    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267541    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267544    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267548    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267550    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267553    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267555    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267558    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267561    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267565    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:14:39.270405 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267568    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267570    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267573    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267576    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267578    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267581    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267584    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267586    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267589    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267591    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267594    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267596    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267599    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267601    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267604    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267606    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267609    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267613    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267616    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267618    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:14:39.270889 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267621    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267623    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267968    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267973    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267976    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267978    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267981    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267983    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267986    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267989    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267991    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267995    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.267998    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268001    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268004    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268010    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268013    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268015    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268019    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268023    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:14:39.271384 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268026    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268028    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268031    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268033    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268036    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268038    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268041    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268044    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268046    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268049    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268051    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268054    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268056    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268059    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268061    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268063    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268066    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268068    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268071    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268073    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:14:39.271927 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268076    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268078    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268080    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268084    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268087    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268089    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268092    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268094    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268097    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268100    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268103    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268105    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268108    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268111    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268113    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268116    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268118    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268121    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268123    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268126    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:14:39.272418 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268128    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268131    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268135    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268138    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268141    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268144    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268146    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268149    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268151    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268154    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268156    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268159    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268161    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268164    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268166    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268170    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268172    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268176    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268178    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:14:39.272918 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268181    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268183    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268186    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268189    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268192    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268194    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268197    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268200    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268202    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268205    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268207    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268209    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268212    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268216    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268219    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268222    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268225    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268227    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268230    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:14:39.273385 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268232    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268235    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268237    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268306    2582 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268338    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268344    2582 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268348    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268351    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268354    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268361    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268365    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268369    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268372    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268376    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268379    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268382    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268385    2582 flags.go:64] FLAG: --cgroup-root=""
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268388    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268391    2582 flags.go:64] FLAG: --client-ca-file=""
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268394    2582 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268398    2582 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268402    2582 flags.go:64] FLAG: --cluster-domain=""
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268405    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 14:14:39.273867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268408    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268411    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268414    2582 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268418    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268421    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268424    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268427    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268430    2582 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268433    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268436    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268439    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268442    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268446    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268461    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268465    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268467    2582 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268471    2582 flags.go:64] FLAG: --enable-server="true"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268473    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268479    2582 flags.go:64] FLAG: --event-burst="100"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268482    2582 flags.go:64] FLAG: --event-qps="50"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268485    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268488    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268491    2582 flags.go:64] FLAG: --eviction-hard=""
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268494    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 14:14:39.274487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268498    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268501    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268504    2582 flags.go:64] FLAG: --eviction-soft=""
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268507    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268510    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268513    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268516    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268519    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268521    2582 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268524    2582 flags.go:64] FLAG: --feature-gates=""
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268528    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268531    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268534    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268537    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268540    2582 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268543    2582 flags.go:64] FLAG: --help="false"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268546    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268548    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268551    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268554    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268558    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268561    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268564    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 14:14:39.275075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268566    2582 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268569    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268572    2582 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268576    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268579    2582 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268582    2582 flags.go:64] FLAG: --kube-reserved=""
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268585    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268589    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268592    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268595    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268598    2582 flags.go:64] FLAG: --lock-file=""
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268600    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268604    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268607    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268612    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268615    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268618    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268621    2582 flags.go:64] FLAG: --logging-format="text"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268624    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268627    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268630    2582 flags.go:64] FLAG: --manifest-url=""
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268632    2582 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268636    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268639    2582 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268643    2582 flags.go:64] FLAG: --max-pods="110"
Sep 16 14:14:39.276031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268646    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268649    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268652    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268655    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268658    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268661    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268664    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268671    2582 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268674    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268677    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268682    2582 flags.go:64] FLAG: --pod-cidr=""
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268685    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268690    2582 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268692    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268696    2582 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268699    2582 flags.go:64] FLAG: --port="10250"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268702    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268705    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-015d077996b74eacf"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268708    2582 flags.go:64] FLAG: --qos-reserved=""
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268711    2582 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268714    2582 flags.go:64] FLAG: --register-node="true"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268717    2582 flags.go:64] FLAG: --register-with-taints=""
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268721    2582 flags.go:64] FLAG: --registry-burst="10"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268724    2582 flags.go:64] FLAG: --registry-qps="5"
Sep 16 14:14:39.277097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268727    2582 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268729    2582 flags.go:64] FLAG: --reserved-memory=""
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268733    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268736    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268739    2582 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268742    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268746    2582 flags.go:64] FLAG: --runonce="false"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268749    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268752    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268755    2582 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268758    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268760    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268764    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268767    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268770    2582 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268772    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268775    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268778    2582 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268781    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268785    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268788    2582 flags.go:64] FLAG: --system-cgroups=""
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268791    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268796    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268799    2582 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268802    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 14:14:39.278147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268806    2582 flags.go:64] FLAG: --tls-min-version=""
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268809    2582 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268812    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268814    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268818    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268821    2582 flags.go:64] FLAG: --v="2"
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268824    2582 flags.go:64] FLAG: --version="false"
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268828    2582 flags.go:64] FLAG: --vmodule=""
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268832    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.268836    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268959    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268963    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268966    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268971    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268973    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268976    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268978    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268988    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268991    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268994    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268997    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:14:39.279203 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.268999    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269002    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269005    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269008    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269010    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269014    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269017    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269019    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269022    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269024    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269027    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269030    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269032    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269035    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269037    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269040    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269043    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269046    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269048    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:14:39.279996 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269051    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269055    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269058    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269061    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269064    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269069    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269072    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269075    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269078    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269081    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269083    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269086    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269089    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269091    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269094    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269096    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269099    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269101    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269104    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269107    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:14:39.280829 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269110    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269112    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269115    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269118    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269121    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269123    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269126    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269128    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269131    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269133    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269137    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269140    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269142    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269145    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269148    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269150    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269153    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269157    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269160    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269163    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:14:39.281434 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269165    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269169    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269172    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269175    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269178    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269181    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269183    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269186    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269188    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269191    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269194    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269196    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269199    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269201    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269204    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269207    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269209    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269212    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269214    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269217    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:14:39.282107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269220    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269223    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269227    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269230    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269233    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269235    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269238    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269240    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.269243    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.269249    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.277513    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.277533    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.277558    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.277568    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 14:14:39.282661 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277651    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277659    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277664    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277670    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277675    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277680    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277685    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277689    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277694    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277699    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277704    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277708    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277712    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277717    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277721    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277726    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277730    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277734    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277739    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277744    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:14:39.283042 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277749    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277754    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277758    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277763    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277767    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277771    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277776    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277780    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277785    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277790    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277795    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277800    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277804    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277808    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277813    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277817    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277822    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277826    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277831    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277835    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:14:39.283612 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277840    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277845    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277851    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277857    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277862    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277867    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277874    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277879    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277884    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277889    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277893    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277897    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277902    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277908    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277912    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277916    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277921    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277926    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277930    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:14:39.284113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277934    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277939    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277944    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277949    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277954    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277958    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277963    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277967    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277971    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277978    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277984    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277989    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.277994    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278000    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278005    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278009    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278014    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278018    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278023    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:14:39.284693 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278028    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278042    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278048    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278052    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278057    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278061    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278065    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278070    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278074    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278078    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278083    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278088    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278092    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278098    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278104    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278109    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278114    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278119    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278123    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278128    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:14:39.285170 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278132    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.278141    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278318    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278328    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278333    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278339    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278343    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278348    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278353    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278358    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278363    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278368    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278375    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278382    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278396    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:14:39.285966 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278401    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278406    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278410    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278415    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278419    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278424    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278429    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278433    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278438    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278443    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278447    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278469    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278473    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278477    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278482    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278486    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278491    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278495    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278499    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278503    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:14:39.286610 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278508    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278512    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278519    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278524    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278529    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278534    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278538    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278543    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278550    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278555    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278560    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278564    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278577    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278582    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278586    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278591    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278595    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278600    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278604    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278608    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:14:39.287492 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278613    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278617    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278622    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278626    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278630    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278635    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278639    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278643    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278648    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278652    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278656    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278660    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278665    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278670    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278674    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278678    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278683    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278687    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278691    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278696    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:14:39.288148 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278700    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278704    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278709    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278713    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278717    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278724    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278729    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278733    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278737    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278742    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278746    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278750    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278755    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278761    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278766    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278771    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278775    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278779    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278784    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278789    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:14:39.288645 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278793    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278798    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278801    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278806    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278810    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:39.278814    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.278823    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.278963    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.281622    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.282638    2582 server.go:1019] "Starting client certificate rotation"
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.282738    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.282769    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.285984    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 14:14:39.289275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.287767    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 14:14:39.302362 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.302346    2582 log.go:25] "Validated CRI v1 runtime API"
Sep 16 14:14:39.306090 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.306076    2582 log.go:25] "Validated CRI v1 image API"
Sep 16 14:14:39.307000 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.306982    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 14:14:39.309222 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.309197    2582 fs.go:135] Filesystem UUIDs: map[34195939-0c45-4db4-bffb-13940a18ac16:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9f03289e-f077-4b45-9687-65da8f462a7b:/dev/nvme0n1p3]
Sep 16 14:14:39.309281 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.309222    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 14:14:39.313895 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.313789    2582 manager.go:216] Machine: {Timestamp:2026-09-16 14:14:39.313297949 +0000 UTC m=+0.313770494 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097736 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2db010da5af97b1fb8e8cd7d06b5c1 SystemUUID:ec2db010-da5a-f97b-1fb8-e8cd7d06b5c1 BootID:efb1b329-15b1-4d74-a878-3b35de0a3b48 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c8:a5:eb:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c8:a5:eb:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:b6:e9:2c:3c:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 14:14:39.313895 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.313894    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 14:14:39.314000 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.313993    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 14:14:39.315482 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.315463    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 14:14:39.315615 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.315486    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-137.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 14:14:39.316636 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.316624    2582 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 14:14:39.316678 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.316638    2582 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 14:14:39.316678 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.316646    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 14:14:39.317276 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.317265    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 14:14:39.317960 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.317951    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 14:14:39.321464 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.321442    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 14:14:39.321862 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.321835    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 14:14:39.321949 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.321885    2582 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 14:14:39.321949 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.321903    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 14:14:39.321949 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.321924    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 14:14:39.321949 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.321937    2582 kubelet.go:398] "Adding apiserver pod source"
Sep 16 14:14:39.321949 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.321950    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 14:14:39.322682 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.322665    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 14:14:39.322758 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.322721    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 14:14:39.323380 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.323361    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 14:14:39.325303 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.325284    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 14:14:39.327130 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.327116    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 14:14:39.327182 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.327147    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 14:14:39.329213 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.329202    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 14:14:39.329258 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.329219    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 14:14:39.329258 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.329226    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 14:14:39.329258 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.329231    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 14:14:39.329258 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.329239    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 14:14:39.329258 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.329245    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 14:14:39.329258 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.329258    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 14:14:39.329409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.329263    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 14:14:39.329409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.329270    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 14:14:39.329409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.329276    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 14:14:39.329409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.329284    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 14:14:39.329409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.329289    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 14:14:39.330083 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.330074    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 14:14:39.330083 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.330083    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 14:14:39.333758 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.333743    2582 server.go:1268] "Started kubelet"
Sep 16 14:14:39.333881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.333826    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 14:14:39.333944 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.333906    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 14:14:39.334338 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.334308    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 14:14:39.334575 ip-10-0-132-137 systemd[1]: Started Kubernetes Kubelet.
Sep 16 14:14:39.334870 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.334854    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 14:14:39.335006 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.334986    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-137.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 14:14:39.335814 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.335744    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 14:14:39.335904 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.335803    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 14:14:39.338368 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.338352    2582 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 14:14:39.340087 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.340069    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 14:14:39.340927 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.340123    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-137.ec2.internal.18d5d2afc61065e1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-137.ec2.internal,UID:ip-10-0-132-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-137.ec2.internal,},FirstTimestamp:2026-09-16 14:14:39.333713377 +0000 UTC m=+0.334185920,LastTimestamp:2026-09-16 14:14:39.333713377 +0000 UTC m=+0.334185920,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-137.ec2.internal,}"
Sep 16 14:14:39.341345 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.341329    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 14:14:39.341808 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.341778    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 14:14:39.341904 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.341882    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:39.342286 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.342264    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 14:14:39.342286 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.342283    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 14:14:39.342427 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.342306    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 14:14:39.342427 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.342357    2582 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 14:14:39.342427 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.342381    2582 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 14:14:39.342601 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.342579    2582 factory.go:55] Registering systemd factory
Sep 16 14:14:39.342654 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.342607    2582 factory.go:223] Registration of the systemd container factory successfully
Sep 16 14:14:39.342788 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.342775    2582 factory.go:153] Registering CRI-O factory
Sep 16 14:14:39.342854 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.342790    2582 factory.go:223] Registration of the crio container factory successfully
Sep 16 14:14:39.342854 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.342837    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 14:14:39.342949 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.342856    2582 factory.go:103] Registering Raw factory
Sep 16 14:14:39.342949 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.342869    2582 manager.go:1196] Started watching for new ooms in manager
Sep 16 14:14:39.343214 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.343202    2582 manager.go:349] Starting recovery of all containers
Sep 16 14:14:39.351852 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.351821    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 14:14:39.351951 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.351832    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 14:14:39.355660 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.355646    2582 manager.go:354] Recovery completed
Sep 16 14:14:39.355748 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.355688    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rfrps"
Sep 16 14:14:39.359841 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.359829    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:14:39.361793 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.361773    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:14:39.361858 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.361805    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:14:39.361858 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.361815    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:14:39.362362 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.362343    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 14:14:39.362362 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.362357    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:14:39.362492 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.362360    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 14:14:39.362492 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.362426    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 14:14:39.363024 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.363009    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:14:39.363094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.363034    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:14:39.363094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.363048    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:14:39.363799 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.363725    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-137.ec2.internal.18d5d2afc7bcdacf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-137.ec2.internal,UID:ip-10-0-132-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-137.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-137.ec2.internal,},FirstTimestamp:2026-09-16 14:14:39.361792719 +0000 UTC m=+0.362265263,LastTimestamp:2026-09-16 14:14:39.361792719 +0000 UTC m=+0.362265263,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-137.ec2.internal,}"
Sep 16 14:14:39.364402 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.364387    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rfrps"
Sep 16 14:14:39.365323 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.365189    2582 policy_none.go:49] "None policy: Start"
Sep 16 14:14:39.365323 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.365325    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 14:14:39.365446 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.365340    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 14:14:39.367436 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.367422    2582 policy_none.go:47] "Start"
Sep 16 14:14:39.405037 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.405018    2582 manager.go:337] "Starting Device Plugin manager"
Sep 16 14:14:39.419389 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.405070    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 14:14:39.419389 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.405083    2582 server.go:87] "Starting device plugin registration server"
Sep 16 14:14:39.419389 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.405347    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 14:14:39.419389 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.405357    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 14:14:39.419389 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.405475    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 14:14:39.419389 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.405565    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 14:14:39.419389 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.405574    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 14:14:39.419389 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.406028    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 14:14:39.419389 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.406068    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:39.465553 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.465524    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 14:14:39.466705 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.466680    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 14:14:39.466784 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.466739    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 14:14:39.466784 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.466764    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 14:14:39.466869 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.466840    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 14:14:39.472638 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.472618    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:14:39.505569 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.505547    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:14:39.506331 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.506315    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:14:39.506394 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.506343    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:14:39.506394 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.506352    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:14:39.506394 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.506393    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.516707 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.516655    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.516707 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.516676    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-137.ec2.internal\": node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:39.542963 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.542942    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:39.567457 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.567436    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-137.ec2.internal"]
Sep 16 14:14:39.567520 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.567508    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:14:39.568809 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.568796    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:14:39.568875 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.568822    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:14:39.568875 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.568832    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:14:39.571007 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.570995    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:14:39.571106 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.571084    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.571151 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.571110    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:14:39.571651 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.571641    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:14:39.571729 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.571654    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:14:39.571729 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.571666    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:14:39.571729 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.571673    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:14:39.571729 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.571682    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:14:39.571729 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.571688    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:14:39.573819 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.573804    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.573883 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.573828    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:14:39.574491 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.574467    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:14:39.574561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.574500    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:14:39.574561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.574511    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:14:39.595921 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.595897    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-137.ec2.internal\" not found" node="ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.600085 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.600069    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-137.ec2.internal\" not found" node="ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.643006 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.642979    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3812848b61d9d5dca266b16230ba7ae6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal\" (UID: \"3812848b61d9d5dca266b16230ba7ae6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.643006 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.642990    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:39.643137 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.643017    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3812848b61d9d5dca266b16230ba7ae6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal\" (UID: \"3812848b61d9d5dca266b16230ba7ae6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.643137 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.643052    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/78732079e26792a8f69e650a5e31b082-config\") pod \"kube-apiserver-proxy-ip-10-0-132-137.ec2.internal\" (UID: \"78732079e26792a8f69e650a5e31b082\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.743880 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.743852    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:39.744009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.743881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3812848b61d9d5dca266b16230ba7ae6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal\" (UID: \"3812848b61d9d5dca266b16230ba7ae6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.744009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.743910    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3812848b61d9d5dca266b16230ba7ae6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal\" (UID: \"3812848b61d9d5dca266b16230ba7ae6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.744009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.743926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/78732079e26792a8f69e650a5e31b082-config\") pod \"kube-apiserver-proxy-ip-10-0-132-137.ec2.internal\" (UID: \"78732079e26792a8f69e650a5e31b082\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.744009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.743960    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/78732079e26792a8f69e650a5e31b082-config\") pod \"kube-apiserver-proxy-ip-10-0-132-137.ec2.internal\" (UID: \"78732079e26792a8f69e650a5e31b082\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.744009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.743967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3812848b61d9d5dca266b16230ba7ae6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal\" (UID: \"3812848b61d9d5dca266b16230ba7ae6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.744009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.743995    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3812848b61d9d5dca266b16230ba7ae6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal\" (UID: \"3812848b61d9d5dca266b16230ba7ae6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.844407 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.844340    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:39.898524 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.898497    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.902356 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:39.902342    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:39.945088 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:39.945058    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:40.045516 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:40.045491    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:40.145881 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:40.145828    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:41.953042 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:41.953017    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:41.989210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:41.989185    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 14:14:41.989651 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:41.989336    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 14:14:42.053131 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:42.053111    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:42.076485 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:42.076456    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 14:09:41 +0000 UTC" deadline="2028-04-18 02:59:28.63287993 +0000 UTC"
Sep 16 14:14:42.076485 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:42.076480    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13908h44m46.556402807s"
Sep 16 14:14:42.148495 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:42.148473    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:14:42.153832 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:42.153811    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:42.207965 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:42.207944    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:14:42.232631 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:42.232605    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3812848b61d9d5dca266b16230ba7ae6.slice/crio-c1c7fec57058e795675d8dad0f4a68e5efbcae8d83f559c2cee0c091ce7912b1 WatchSource:0}: Error finding container c1c7fec57058e795675d8dad0f4a68e5efbcae8d83f559c2cee0c091ce7912b1: Status 404 returned error can't find the container with id c1c7fec57058e795675d8dad0f4a68e5efbcae8d83f559c2cee0c091ce7912b1
Sep 16 14:14:42.236264 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:42.236248    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:14:42.254758 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:42.254740    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-137.ec2.internal\" not found"
Sep 16 14:14:42.295861 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:42.295841    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:14:42.309643 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:42.309622    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78732079e26792a8f69e650a5e31b082.slice/crio-d55f6ab3c4f6c0c02c5d438f4e87ddc1a977c007c8ac6f8b5fa4c47ba1be527b WatchSource:0}: Error finding container d55f6ab3c4f6c0c02c5d438f4e87ddc1a977c007c8ac6f8b5fa4c47ba1be527b: Status 404 returned error can't find the container with id d55f6ab3c4f6c0c02c5d438f4e87ddc1a977c007c8ac6f8b5fa4c47ba1be527b
Sep 16 14:14:42.349474 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:42.349451    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:42.364974 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:42.364953    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 14:14:42.365949 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:42.365936    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-137.ec2.internal"
Sep 16 14:14:42.377354 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:42.377315    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 14:14:43.031187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.031158    2582 apiserver.go:52] "Watching apiserver"
Sep 16 14:14:43.040118 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.040095    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 14:14:43.040569 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.040539    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-f2tnp","openshift-multus/network-metrics-daemon-cpn5j","kube-system/global-pull-secret-syncer-2k2x2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal","openshift-multus/multus-wdv2g","openshift-network-diagnostics/network-check-target-km9bl","openshift-network-operator/iptables-alerter-nkrwr","openshift-ovn-kubernetes/ovnkube-node-5mgd5","kube-system/konnectivity-agent-dwfhh","kube-system/kube-apiserver-proxy-ip-10-0-132-137.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96","openshift-cluster-node-tuning-operator/tuned-cj9ct","openshift-dns/node-resolver-jr5mz","openshift-image-registry/node-ca-pt6kn"]
Sep 16 14:14:43.043259 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.043217    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jr5mz"
Sep 16 14:14:43.045665 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.045645    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:43.045757 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.045732    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 14:14:43.045818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.045796    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 14:14:43.045910 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.045725    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:14:43.045968 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.045920    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9qxnn\""
Sep 16 14:14:43.047746 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.047724    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:43.047839 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.047804    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:14:43.049111 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.049081    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 14:14:43.050043 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.050011    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.052453 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.052430    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.053008 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.052854    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tv9ch\""
Sep 16 14:14:43.054460 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.054399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:43.054528 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.054490    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:14:43.055485 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.054879    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 14:14:43.055485 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.054910    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9w52m\""
Sep 16 14:14:43.055485 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.055007    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 14:14:43.055485 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.055112    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 14:14:43.055485 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.055130    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 14:14:43.055485 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.055147    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 14:14:43.055485 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.055223    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 14:14:43.057424 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.057340    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nkrwr"
Sep 16 14:14:43.058977 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.058958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv4d4\" (UniqueName: \"kubernetes.io/projected/9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08-kube-api-access-tv4d4\") pod \"node-resolver-jr5mz\" (UID: \"9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08\") " pod="openshift-dns/node-resolver-jr5mz"
Sep 16 14:14:43.059059 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.058995    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-cnibin\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.059059 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059039    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.059228 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.059228 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:43.059228 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8630dc8c-6050-4063-9fd3-d5f0b96683d2-dbus\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:43.059228 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-system-cni-dir\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.059228 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08-hosts-file\") pod \"node-resolver-jr5mz\" (UID: \"9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08\") " pod="openshift-dns/node-resolver-jr5mz"
Sep 16 14:14:43.059228 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhrdj\" (UniqueName: \"kubernetes.io/projected/593aebe3-f161-4db4-98a5-611d40cb8bc4-kube-api-access-hhrdj\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:43.059228 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059223    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8630dc8c-6050-4063-9fd3-d5f0b96683d2-kubelet-config\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:43.059574 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059265    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.059574 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059319    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08-tmp-dir\") pod \"node-resolver-jr5mz\" (UID: \"9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08\") " pod="openshift-dns/node-resolver-jr5mz"
Sep 16 14:14:43.059574 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059347    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:43.059574 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059373    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-cni-binary-copy\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.059574 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2cc5\" (UniqueName: \"kubernetes.io/projected/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-kube-api-access-r2cc5\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.060185 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.059914    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-crhd9\""
Sep 16 14:14:43.060185 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.060150    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 14:14:43.062074 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.062018    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:14:43.062074 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.062050    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.062622 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.062603    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 14:14:43.065609 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.063785    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dwfhh"
Sep 16 14:14:43.065609 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.064596    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 14:14:43.066182 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.066147    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 14:14:43.066280 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.066201    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 14:14:43.066609 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.066493    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 14:14:43.066609 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.066535    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 14:14:43.066869 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.066851    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 14:14:43.066957 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.066939    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ppct7\""
Sep 16 14:14:43.067230 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.067205    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 14:14:43.067315 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.067299    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 14:14:43.067370 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.067311    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 14:14:43.068295 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.068277    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-78lrp\""
Sep 16 14:14:43.068892 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.068867    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pt6kn"
Sep 16 14:14:43.071518 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.071502    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:14:43.072443 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.072428    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 14:14:43.073097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.072654    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 14:14:43.073097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.072897    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 14:14:43.073097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.072929    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rcp94\""
Sep 16 14:14:43.073097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.073069    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.075491 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.075472    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.075667 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.075648    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q9gn8\""
Sep 16 14:14:43.075914 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.075896    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 14:14:43.076172 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.076156    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 14:14:43.076424 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.076407    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 14:14:43.077983 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.077964    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:14:43.078476 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.078455    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2f6v9\""
Sep 16 14:14:43.078657 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.078638    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 14:14:43.090013 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.089254    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cjsr8"
Sep 16 14:14:43.098711 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.098690    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cjsr8"
Sep 16 14:14:43.150921 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.150900    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 14:14:43.160372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160351    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-run-systemd\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.160486 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160382    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-node-log\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.160486 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-host\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.160486 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-etc-kubernetes\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.160486 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mck47\" (UniqueName: \"kubernetes.io/projected/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-kube-api-access-mck47\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.160486 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.160738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160497    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-modprobe-d\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.160738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8630dc8c-6050-4063-9fd3-d5f0b96683d2-kubelet-config\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:43.160738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.160738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160617    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e14f017f-8f29-427c-8791-536d0c01b024-etc-tuned\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.160738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08-tmp-dir\") pod \"node-resolver-jr5mz\" (UID: \"9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08\") " pod="openshift-dns/node-resolver-jr5mz"
Sep 16 14:14:43.160738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160649    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8630dc8c-6050-4063-9fd3-d5f0b96683d2-kubelet-config\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:43.160738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2cc5\" (UniqueName: \"kubernetes.io/projected/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-kube-api-access-r2cc5\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.160738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160693    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f28ab05-ab08-4680-bbf3-217236c89965-serviceca\") pod \"node-ca-pt6kn\" (UID: \"4f28ab05-ab08-4680-bbf3-217236c89965\") " pod="openshift-image-registry/node-ca-pt6kn"
Sep 16 14:14:43.161094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160838    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.161094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-sysconfig\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.161094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160907    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-hostroot\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.161094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4d4\" (UniqueName: \"kubernetes.io/projected/9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08-kube-api-access-tv4d4\") pod \"node-resolver-jr5mz\" (UID: \"9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08\") " pod="openshift-dns/node-resolver-jr5mz"
Sep 16 14:14:43.161094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.160970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w62l6\" (UniqueName: \"kubernetes.io/projected/a028f488-a7a9-4066-bde6-f83e53817ac5-kube-api-access-w62l6\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.161094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161003    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08-tmp-dir\") pod \"node-resolver-jr5mz\" (UID: \"9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08\") " pod="openshift-dns/node-resolver-jr5mz"
Sep 16 14:14:43.161094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161085    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-cni-bin\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.161481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161112    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:43.161481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-kubelet\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.161481 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.161210    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:14:43.161481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161282    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.161481 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.161288    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs podName:593aebe3-f161-4db4-98a5-611d40cb8bc4 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:43.661264211 +0000 UTC m=+2.954952687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs") pod "network-metrics-daemon-cpn5j" (UID: "593aebe3-f161-4db4-98a5-611d40cb8bc4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:14:43.161481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161317    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnksg\" (UniqueName: \"kubernetes.io/projected/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-kube-api-access-gnksg\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.161481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-multus-socket-dir-parent\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.161481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161397    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-var-lib-cni-multus\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.161481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-systemd\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.161481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161474    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-cni-binary-copy\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161497    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-etc-openvswitch\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-run-ovn\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-run\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e14f017f-8f29-427c-8791-536d0c01b024-tmp\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-socket-dir\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-systemd-units\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161774    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f28ab05-ab08-4680-bbf3-217236c89965-host\") pod \"node-ca-pt6kn\" (UID: \"4f28ab05-ab08-4680-bbf3-217236c89965\") " pod="openshift-image-registry/node-ca-pt6kn"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-kubernetes\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-system-cni-dir\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-multus-cni-dir\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-cnibin\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-run-k8s-cni-cncf-io\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.161959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161943    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-var-lib-kubelet\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.161966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-multus-daemon-config\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-slash\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162068    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-cni-binary-copy\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162074    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-var-lib-openvswitch\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162106    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-ovnkube-config\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5vlr\" (UniqueName: \"kubernetes.io/projected/4f28ab05-ab08-4680-bbf3-217236c89965-kube-api-access-k5vlr\") pod \"node-ca-pt6kn\" (UID: \"4f28ab05-ab08-4680-bbf3-217236c89965\") " pod="openshift-image-registry/node-ca-pt6kn"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162159    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08-hosts-file\") pod \"node-resolver-jr5mz\" (UID: \"9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08\") " pod="openshift-dns/node-resolver-jr5mz"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhrdj\" (UniqueName: \"kubernetes.io/projected/593aebe3-f161-4db4-98a5-611d40cb8bc4-kube-api-access-hhrdj\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162208    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-registration-dir\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2092b9b3-0313-44ff-982e-e9f0f67a955e-agent-certs\") pod \"konnectivity-agent-dwfhh\" (UID: \"2092b9b3-0313-44ff-982e-e9f0f67a955e\") " pod="kube-system/konnectivity-agent-dwfhh"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-run-openvswitch\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-cni-netd\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-env-overrides\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-etc-selinux\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162434    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xhnk\" (UniqueName: \"kubernetes.io/projected/c650c79a-d593-409f-86ab-794fd1232d28-kube-api-access-5xhnk\") pod \"iptables-alerter-nkrwr\" (UID: \"c650c79a-d593-409f-86ab-794fd1232d28\") " pod="openshift-network-operator/iptables-alerter-nkrwr"
Sep 16 14:14:43.162818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52gx4\" (UniqueName: \"kubernetes.io/projected/e14f017f-8f29-427c-8791-536d0c01b024-kube-api-access-52gx4\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162478    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-system-cni-dir\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162491    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08-hosts-file\") pod \"node-resolver-jr5mz\" (UID: \"9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08\") " pod="openshift-dns/node-resolver-jr5mz"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-var-lib-cni-bin\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162579    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-cnibin\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162633    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-sys-fs\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162742    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-cnibin\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162785    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c650c79a-d593-409f-86ab-794fd1232d28-host-slash\") pod \"iptables-alerter-nkrwr\" (UID: \"c650c79a-d593-409f-86ab-794fd1232d28\") " pod="openshift-network-operator/iptables-alerter-nkrwr"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-log-socket\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-var-lib-kubelet\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162878    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-cni-binary-copy\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8630dc8c-6050-4063-9fd3-d5f0b96683d2-dbus\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162924    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6slxc\" (UniqueName: \"kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc\") pod \"network-check-target-km9bl\" (UID: \"39e55065-d817-4754-8d8a-82da3c8be530\") " pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.162989    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8630dc8c-6050-4063-9fd3-d5f0b96683d2-dbus\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163003    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.163701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163005    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-device-dir\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163071    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-sysctl-d\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-run-netns\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-run-netns\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-lib-modules\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163226    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c650c79a-d593-409f-86ab-794fd1232d28-iptables-alerter-script\") pod \"iptables-alerter-nkrwr\" (UID: \"c650c79a-d593-409f-86ab-794fd1232d28\") " pod="openshift-network-operator/iptables-alerter-nkrwr"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.163307    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163289    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163270    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-sys\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.163365    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret podName:8630dc8c-6050-4063-9fd3-d5f0b96683d2 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:43.663347425 +0000 UTC m=+2.957035895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret") pod "global-pull-secret-syncer-2k2x2" (UID: "8630dc8c-6050-4063-9fd3-d5f0b96683d2") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-multus-conf-dir\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-run-multus-certs\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2092b9b3-0313-44ff-982e-e9f0f67a955e-konnectivity-ca\") pod \"konnectivity-agent-dwfhh\" (UID: \"2092b9b3-0313-44ff-982e-e9f0f67a955e\") " pod="kube-system/konnectivity-agent-dwfhh"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163484    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-ovn-node-metrics-cert\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.164494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-ovnkube-script-lib\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.165282 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163582    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-sysctl-conf\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.165282 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.163644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-system-cni-dir\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.168301 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.167916    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 14:14:43.175390 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.174446    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2cc5\" (UniqueName: \"kubernetes.io/projected/8701a4fe-ab7c-45af-af75-0e6dfbeccc78-kube-api-access-r2cc5\") pod \"multus-additional-cni-plugins-f2tnp\" (UID: \"8701a4fe-ab7c-45af-af75-0e6dfbeccc78\") " pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.175390 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.175091    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhrdj\" (UniqueName: \"kubernetes.io/projected/593aebe3-f161-4db4-98a5-611d40cb8bc4-kube-api-access-hhrdj\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:43.175541 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.175451    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv4d4\" (UniqueName: \"kubernetes.io/projected/9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08-kube-api-access-tv4d4\") pod \"node-resolver-jr5mz\" (UID: \"9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08\") " pod="openshift-dns/node-resolver-jr5mz"
Sep 16 14:14:43.179885 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.179842    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal" event={"ID":"3812848b61d9d5dca266b16230ba7ae6","Type":"ContainerStarted","Data":"c1c7fec57058e795675d8dad0f4a68e5efbcae8d83f559c2cee0c091ce7912b1"}
Sep 16 14:14:43.181295 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.181272    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-137.ec2.internal" event={"ID":"78732079e26792a8f69e650a5e31b082","Type":"ContainerStarted","Data":"d55f6ab3c4f6c0c02c5d438f4e87ddc1a977c007c8ac6f8b5fa4c47ba1be527b"}
Sep 16 14:14:43.264057 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264009    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-etc-selinux\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.264209 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xhnk\" (UniqueName: \"kubernetes.io/projected/c650c79a-d593-409f-86ab-794fd1232d28-kube-api-access-5xhnk\") pod \"iptables-alerter-nkrwr\" (UID: \"c650c79a-d593-409f-86ab-794fd1232d28\") " pod="openshift-network-operator/iptables-alerter-nkrwr"
Sep 16 14:14:43.264209 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264106    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52gx4\" (UniqueName: \"kubernetes.io/projected/e14f017f-8f29-427c-8791-536d0c01b024-kube-api-access-52gx4\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.264209 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-var-lib-cni-bin\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.264396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-sys-fs\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.264396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c650c79a-d593-409f-86ab-794fd1232d28-host-slash\") pod \"iptables-alerter-nkrwr\" (UID: \"c650c79a-d593-409f-86ab-794fd1232d28\") " pod="openshift-network-operator/iptables-alerter-nkrwr"
Sep 16 14:14:43.264396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264280    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-log-socket\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.264396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264330    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-var-lib-kubelet\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.264396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-cni-binary-copy\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.264649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264418    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-var-lib-cni-bin\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.264649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6slxc\" (UniqueName: \"kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc\") pod \"network-check-target-km9bl\" (UID: \"39e55065-d817-4754-8d8a-82da3c8be530\") " pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:43.264649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.264649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264529    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-device-dir\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.264649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-sysctl-d\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.264649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-run-netns\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.264649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-etc-selinux\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.264649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-run-netns\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.264649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264629    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-run-netns\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.264989 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264693    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.264989 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-device-dir\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.264989 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264631    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-lib-modules\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.264989 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264949    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-run-netns\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.264989 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264966    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-log-socket\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264994    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-cni-binary-copy\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c650c79a-d593-409f-86ab-794fd1232d28-iptables-alerter-script\") pod \"iptables-alerter-nkrwr\" (UID: \"c650c79a-d593-409f-86ab-794fd1232d28\") " pod="openshift-network-operator/iptables-alerter-nkrwr"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265045    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-sys\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265055    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-lib-modules\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264993    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-var-lib-kubelet\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.264956    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-sysctl-d\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-multus-conf-dir\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265093    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c650c79a-d593-409f-86ab-794fd1232d28-host-slash\") pod \"iptables-alerter-nkrwr\" (UID: \"c650c79a-d593-409f-86ab-794fd1232d28\") " pod="openshift-network-operator/iptables-alerter-nkrwr"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-multus-conf-dir\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-run-multus-certs\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265167    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-sys\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265197    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-sys-fs\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265204    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-run-multus-certs\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.265210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2092b9b3-0313-44ff-982e-e9f0f67a955e-konnectivity-ca\") pod \"konnectivity-agent-dwfhh\" (UID: \"2092b9b3-0313-44ff-982e-e9f0f67a955e\") " pod="kube-system/konnectivity-agent-dwfhh"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265259    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-ovn-node-metrics-cert\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-ovnkube-script-lib\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-sysctl-conf\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265334    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-system-cni-dir\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-run-systemd\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-node-log\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-host\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-etc-kubernetes\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mck47\" (UniqueName: \"kubernetes.io/projected/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-kube-api-access-mck47\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265484    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c650c79a-d593-409f-86ab-794fd1232d28-iptables-alerter-script\") pod \"iptables-alerter-nkrwr\" (UID: \"c650c79a-d593-409f-86ab-794fd1232d28\") " pod="openshift-network-operator/iptables-alerter-nkrwr"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265492    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265537    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-system-cni-dir\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265551    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-host\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265551    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-sysctl-conf\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265562    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265587    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-etc-kubernetes\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265600    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-run-systemd\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.265889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265640    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-node-log\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-modprobe-d\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e14f017f-8f29-427c-8791-536d0c01b024-etc-tuned\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f28ab05-ab08-4680-bbf3-217236c89965-serviceca\") pod \"node-ca-pt6kn\" (UID: \"4f28ab05-ab08-4680-bbf3-217236c89965\") " pod="openshift-image-registry/node-ca-pt6kn"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2092b9b3-0313-44ff-982e-e9f0f67a955e-konnectivity-ca\") pod \"konnectivity-agent-dwfhh\" (UID: \"2092b9b3-0313-44ff-982e-e9f0f67a955e\") " pod="kube-system/konnectivity-agent-dwfhh"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265775    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-modprobe-d\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265789    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-sysconfig\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-hostroot\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265842    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w62l6\" (UniqueName: \"kubernetes.io/projected/a028f488-a7a9-4066-bde6-f83e53817ac5-kube-api-access-w62l6\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265866    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-cni-bin\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265875    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-sysconfig\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265895    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-hostroot\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-kubelet\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-ovnkube-script-lib\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnksg\" (UniqueName: \"kubernetes.io/projected/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-kube-api-access-gnksg\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265977    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-kubelet\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.266696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-cni-bin\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.265993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-multus-socket-dir-parent\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-var-lib-cni-multus\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266035    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-systemd\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266082    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-var-lib-cni-multus\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-etc-openvswitch\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266158    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-systemd\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266167    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-etc-openvswitch\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266170    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f28ab05-ab08-4680-bbf3-217236c89965-serviceca\") pod \"node-ca-pt6kn\" (UID: \"4f28ab05-ab08-4680-bbf3-217236c89965\") " pod="openshift-image-registry/node-ca-pt6kn"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266189    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-run-ovn\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266202    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-multus-socket-dir-parent\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-run\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e14f017f-8f29-427c-8791-536d0c01b024-tmp\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266260    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-run-ovn\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266268    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-socket-dir\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266289    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-run\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-systemd-units\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.267529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266335    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f28ab05-ab08-4680-bbf3-217236c89965-host\") pod \"node-ca-pt6kn\" (UID: \"4f28ab05-ab08-4680-bbf3-217236c89965\") " pod="openshift-image-registry/node-ca-pt6kn"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266353    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-systemd-units\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266381    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f28ab05-ab08-4680-bbf3-217236c89965-host\") pod \"node-ca-pt6kn\" (UID: \"4f28ab05-ab08-4680-bbf3-217236c89965\") " pod="openshift-image-registry/node-ca-pt6kn"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-kubernetes\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266405    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-socket-dir\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-multus-cni-dir\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266437    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e14f017f-8f29-427c-8791-536d0c01b024-etc-kubernetes\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-cnibin\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-run-k8s-cni-cncf-io\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266498    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-multus-cni-dir\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-cnibin\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266513    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-var-lib-kubelet\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-multus-daemon-config\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266545    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-run-k8s-cni-cncf-io\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-slash\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266598    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-host-var-lib-kubelet\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-var-lib-openvswitch\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266638    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-ovnkube-config\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.268372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266643    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-var-lib-openvswitch\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266677    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5vlr\" (UniqueName: \"kubernetes.io/projected/4f28ab05-ab08-4680-bbf3-217236c89965-kube-api-access-k5vlr\") pod \"node-ca-pt6kn\" (UID: \"4f28ab05-ab08-4680-bbf3-217236c89965\") " pod="openshift-image-registry/node-ca-pt6kn"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-registration-dir\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2092b9b3-0313-44ff-982e-e9f0f67a955e-agent-certs\") pod \"konnectivity-agent-dwfhh\" (UID: \"2092b9b3-0313-44ff-982e-e9f0f67a955e\") " pod="kube-system/konnectivity-agent-dwfhh"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266762    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-run-openvswitch\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-cni-netd\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-env-overrides\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266875    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a028f488-a7a9-4066-bde6-f83e53817ac5-registration-dir\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266930    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-slash\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.266992    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-multus-daemon-config\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.267051    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-run-openvswitch\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.267108    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-ovnkube-config\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.267157    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-host-cni-netd\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.267277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-env-overrides\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.268469    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e14f017f-8f29-427c-8791-536d0c01b024-etc-tuned\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.269226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.268691    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-ovn-node-metrics-cert\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.270432 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.270391    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2092b9b3-0313-44ff-982e-e9f0f67a955e-agent-certs\") pod \"konnectivity-agent-dwfhh\" (UID: \"2092b9b3-0313-44ff-982e-e9f0f67a955e\") " pod="kube-system/konnectivity-agent-dwfhh"
Sep 16 14:14:43.272705 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.272023    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:14:43.272705 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.272046    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:14:43.272705 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.272059    2582 projected.go:196] Error preparing data for projected volume kube-api-access-6slxc for pod openshift-network-diagnostics/network-check-target-km9bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:14:43.272705 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.272114    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc podName:39e55065-d817-4754-8d8a-82da3c8be530 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:43.77209651 +0000 UTC m=+3.065785026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6slxc" (UniqueName: "kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc") pod "network-check-target-km9bl" (UID: "39e55065-d817-4754-8d8a-82da3c8be530") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:14:43.273353 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.273330    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e14f017f-8f29-427c-8791-536d0c01b024-tmp\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.274596 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.274572    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xhnk\" (UniqueName: \"kubernetes.io/projected/c650c79a-d593-409f-86ab-794fd1232d28-kube-api-access-5xhnk\") pod \"iptables-alerter-nkrwr\" (UID: \"c650c79a-d593-409f-86ab-794fd1232d28\") " pod="openshift-network-operator/iptables-alerter-nkrwr"
Sep 16 14:14:43.275841 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.275814    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w62l6\" (UniqueName: \"kubernetes.io/projected/a028f488-a7a9-4066-bde6-f83e53817ac5-kube-api-access-w62l6\") pod \"aws-ebs-csi-driver-node-8kv96\" (UID: \"a028f488-a7a9-4066-bde6-f83e53817ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.276125 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.276105    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mck47\" (UniqueName: \"kubernetes.io/projected/c8a90e22-bb92-4813-bb0a-45a8d926b3b4-kube-api-access-mck47\") pod \"multus-wdv2g\" (UID: \"c8a90e22-bb92-4813-bb0a-45a8d926b3b4\") " pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.277883 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.277856    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52gx4\" (UniqueName: \"kubernetes.io/projected/e14f017f-8f29-427c-8791-536d0c01b024-kube-api-access-52gx4\") pod \"tuned-cj9ct\" (UID: \"e14f017f-8f29-427c-8791-536d0c01b024\") " pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.278317 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.278286    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5vlr\" (UniqueName: \"kubernetes.io/projected/4f28ab05-ab08-4680-bbf3-217236c89965-kube-api-access-k5vlr\") pod \"node-ca-pt6kn\" (UID: \"4f28ab05-ab08-4680-bbf3-217236c89965\") " pod="openshift-image-registry/node-ca-pt6kn"
Sep 16 14:14:43.278435 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.278321    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnksg\" (UniqueName: \"kubernetes.io/projected/5f37dbc7-344e-46ec-969e-fb4f7afb4efa-kube-api-access-gnksg\") pod \"ovnkube-node-5mgd5\" (UID: \"5f37dbc7-344e-46ec-969e-fb4f7afb4efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.359558 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.359482    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jr5mz"
Sep 16 14:14:43.370945 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.370919    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f2tnp"
Sep 16 14:14:43.382803 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.382778    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wdv2g"
Sep 16 14:14:43.390838 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.390818    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nkrwr"
Sep 16 14:14:43.398769 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.398751    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:14:43.407429 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.407409    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dwfhh"
Sep 16 14:14:43.416078 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.416025    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pt6kn"
Sep 16 14:14:43.423711 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.423689    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96"
Sep 16 14:14:43.430312 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.430292    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cj9ct"
Sep 16 14:14:43.670044 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.669959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:43.670044 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.670012    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:43.670265 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.670108    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:14:43.670265 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.670174    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret podName:8630dc8c-6050-4063-9fd3-d5f0b96683d2 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:44.670157875 +0000 UTC m=+3.963846332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret") pod "global-pull-secret-syncer-2k2x2" (UID: "8630dc8c-6050-4063-9fd3-d5f0b96683d2") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:14:43.670265 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.670117    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:14:43.670265 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.670257    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs podName:593aebe3-f161-4db4-98a5-611d40cb8bc4 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:44.670229134 +0000 UTC m=+3.963917604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs") pod "network-metrics-daemon-cpn5j" (UID: "593aebe3-f161-4db4-98a5-611d40cb8bc4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:14:43.871252 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:43.871206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6slxc\" (UniqueName: \"kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc\") pod \"network-check-target-km9bl\" (UID: \"39e55065-d817-4754-8d8a-82da3c8be530\") " pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:43.871432 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.871388    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:14:43.871432 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.871410    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:14:43.871432 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.871420    2582 projected.go:196] Error preparing data for projected volume kube-api-access-6slxc for pod openshift-network-diagnostics/network-check-target-km9bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:14:43.871590 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:43.871471    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc podName:39e55065-d817-4754-8d8a-82da3c8be530 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:44.871458079 +0000 UTC m=+4.165146542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6slxc" (UniqueName: "kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc") pod "network-check-target-km9bl" (UID: "39e55065-d817-4754-8d8a-82da3c8be530") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:14:44.102350 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:44.102260    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 14:09:43 +0000 UTC" deadline="2028-03-19 01:54:57.091907255 +0000 UTC"
Sep 16 14:14:44.102350 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:44.102300    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13187h40m12.989610937s"
Sep 16 14:14:44.376537 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:44.376509    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2092b9b3_0313_44ff_982e_e9f0f67a955e.slice/crio-f7d83c42d3dc0762a6b6a53dcce09cbefd29a17b0ec98a41124b25532a821271 WatchSource:0}: Error finding container f7d83c42d3dc0762a6b6a53dcce09cbefd29a17b0ec98a41124b25532a821271: Status 404 returned error can't find the container with id f7d83c42d3dc0762a6b6a53dcce09cbefd29a17b0ec98a41124b25532a821271
Sep 16 14:14:44.377661 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:44.377634    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14f017f_8f29_427c_8791_536d0c01b024.slice/crio-50581eac7b359db4c02e32166d7138e0f569c2e8ef70f3d895a2a9c1579d0748 WatchSource:0}: Error finding container 50581eac7b359db4c02e32166d7138e0f569c2e8ef70f3d895a2a9c1579d0748: Status 404 returned error can't find the container with id 50581eac7b359db4c02e32166d7138e0f569c2e8ef70f3d895a2a9c1579d0748
Sep 16 14:14:44.378844 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:44.378491    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda028f488_a7a9_4066_bde6_f83e53817ac5.slice/crio-eff0e825f8077446ef3c469bf90c73a452829a1b53bb4f3f204ae43a3d623d30 WatchSource:0}: Error finding container eff0e825f8077446ef3c469bf90c73a452829a1b53bb4f3f204ae43a3d623d30: Status 404 returned error can't find the container with id eff0e825f8077446ef3c469bf90c73a452829a1b53bb4f3f204ae43a3d623d30
Sep 16 14:14:44.382623 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:44.382524    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f28ab05_ab08_4680_bbf3_217236c89965.slice/crio-09055d4bdb34faf747ee02b3c2e2b1c7947ea4336d88f8b20f924ebe573f93b7 WatchSource:0}: Error finding container 09055d4bdb34faf747ee02b3c2e2b1c7947ea4336d88f8b20f924ebe573f93b7: Status 404 returned error can't find the container with id 09055d4bdb34faf747ee02b3c2e2b1c7947ea4336d88f8b20f924ebe573f93b7
Sep 16 14:14:44.386799 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:14:44.384014    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc650c79a_d593_409f_86ab_794fd1232d28.slice/crio-bf53cabb4bee24076611e4e2e9130cf552e9f1bee5899f56512789540066eecc WatchSource:0}: Error finding container bf53cabb4bee24076611e4e2e9130cf552e9f1bee5899f56512789540066eecc: Status 404 returned error can't find the container with id bf53cabb4bee24076611e4e2e9130cf552e9f1bee5899f56512789540066eecc
Sep 16 14:14:44.676446 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:44.676232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:44.676446 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:44.676441    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:44.676577 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:44.676381    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:14:44.676577 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:44.676520    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:14:44.676577 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:44.676540    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret podName:8630dc8c-6050-4063-9fd3-d5f0b96683d2 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:46.676522039 +0000 UTC m=+5.970210501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret") pod "global-pull-secret-syncer-2k2x2" (UID: "8630dc8c-6050-4063-9fd3-d5f0b96683d2") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:14:44.676577 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:44.676558    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs podName:593aebe3-f161-4db4-98a5-611d40cb8bc4 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:46.676547731 +0000 UTC m=+5.970236193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs") pod "network-metrics-daemon-cpn5j" (UID: "593aebe3-f161-4db4-98a5-611d40cb8bc4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:14:44.877246 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:44.877191    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6slxc\" (UniqueName: \"kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc\") pod \"network-check-target-km9bl\" (UID: \"39e55065-d817-4754-8d8a-82da3c8be530\") " pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:44.877411 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:44.877383    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:14:44.877411 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:44.877402    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:14:44.877493 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:44.877413    2582 projected.go:196] Error preparing data for projected volume kube-api-access-6slxc for pod openshift-network-diagnostics/network-check-target-km9bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:14:44.877493 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:44.877476    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc podName:39e55065-d817-4754-8d8a-82da3c8be530 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:46.877457978 +0000 UTC m=+6.171146436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6slxc" (UniqueName: "kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc") pod "network-check-target-km9bl" (UID: "39e55065-d817-4754-8d8a-82da3c8be530") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:14:45.102723 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.102612    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 14:09:43 +0000 UTC" deadline="2028-06-08 07:58:22.942032176 +0000 UTC"
Sep 16 14:14:45.102723 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.102669    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15137h43m37.839366961s"
Sep 16 14:14:45.176588 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.176557    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:45.176755 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:45.176687    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:14:45.177092 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.177072    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:45.177201 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:45.177180    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:14:45.177281 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.177261    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:45.177344 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:45.177331    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:14:45.191488 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.191455    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96" event={"ID":"a028f488-a7a9-4066-bde6-f83e53817ac5","Type":"ContainerStarted","Data":"eff0e825f8077446ef3c469bf90c73a452829a1b53bb4f3f204ae43a3d623d30"}
Sep 16 14:14:45.196357 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.196278    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dwfhh" event={"ID":"2092b9b3-0313-44ff-982e-e9f0f67a955e","Type":"ContainerStarted","Data":"f7d83c42d3dc0762a6b6a53dcce09cbefd29a17b0ec98a41124b25532a821271"}
Sep 16 14:14:45.199436 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.198951    2582 generic.go:356] "Generic (PLEG): container finished" podID="3812848b61d9d5dca266b16230ba7ae6" containerID="b7b9507d8129e9e42fece2ef7b8689149aadd1ac6532180321f4801dd414a6b7" exitCode=0
Sep 16 14:14:45.199436 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.199037    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal" event={"ID":"3812848b61d9d5dca266b16230ba7ae6","Type":"ContainerDied","Data":"b7b9507d8129e9e42fece2ef7b8689149aadd1ac6532180321f4801dd414a6b7"}
Sep 16 14:14:45.203484 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.203397    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5" event={"ID":"5f37dbc7-344e-46ec-969e-fb4f7afb4efa","Type":"ContainerStarted","Data":"6357002918b978e49e9ed20e848153c5e8d574f746340694a98cda6074f53ac3"}
Sep 16 14:14:45.205315 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.205284    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wdv2g" event={"ID":"c8a90e22-bb92-4813-bb0a-45a8d926b3b4","Type":"ContainerStarted","Data":"05b563e61a1fe47bf917fddc7a4a90c116e59f4823a4fe2b0b546991988599e1"}
Sep 16 14:14:45.207997 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.207939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nkrwr" event={"ID":"c650c79a-d593-409f-86ab-794fd1232d28","Type":"ContainerStarted","Data":"bf53cabb4bee24076611e4e2e9130cf552e9f1bee5899f56512789540066eecc"}
Sep 16 14:14:45.211904 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.211881    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pt6kn" event={"ID":"4f28ab05-ab08-4680-bbf3-217236c89965","Type":"ContainerStarted","Data":"09055d4bdb34faf747ee02b3c2e2b1c7947ea4336d88f8b20f924ebe573f93b7"}
Sep 16 14:14:45.216162 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.216112    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cj9ct" event={"ID":"e14f017f-8f29-427c-8791-536d0c01b024","Type":"ContainerStarted","Data":"50581eac7b359db4c02e32166d7138e0f569c2e8ef70f3d895a2a9c1579d0748"}
Sep 16 14:14:45.222397 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.222371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-137.ec2.internal" event={"ID":"78732079e26792a8f69e650a5e31b082","Type":"ContainerStarted","Data":"c8d721a0603080af9c6d0bca28bebc1afffde916ce28a560480dd297a4dc14ef"}
Sep 16 14:14:45.227975 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.227903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2tnp" event={"ID":"8701a4fe-ab7c-45af-af75-0e6dfbeccc78","Type":"ContainerStarted","Data":"3d9d081d6cad2e5e7333055f1c876308d26db5f1069827eb1fe1dfc0cc1b8505"}
Sep 16 14:14:45.236435 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:45.236412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jr5mz" event={"ID":"9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08","Type":"ContainerStarted","Data":"0c59d622c19e3502189a666be29f550fc56df3007019d544562338fda097ff45"}
Sep 16 14:14:46.268790 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:46.268758    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal" event={"ID":"3812848b61d9d5dca266b16230ba7ae6","Type":"ContainerStarted","Data":"25e3a8cde9f13330b57d2aa0407d8608afa0903e563fc2ba249e2b7313830c63"}
Sep 16 14:14:46.299224 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:46.299156    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-137.ec2.internal" podStartSLOduration=4.2991342679999995 podStartE2EDuration="4.299134268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:14:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:14:45.239741453 +0000 UTC m=+4.533429934" watchObservedRunningTime="2026-09-16 14:14:46.299134268 +0000 UTC m=+5.592822748"
Sep 16 14:14:46.299976 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:46.299938    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-137.ec2.internal" podStartSLOduration=4.299922102 podStartE2EDuration="4.299922102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:14:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:14:46.297634597 +0000 UTC m=+5.591323098" watchObservedRunningTime="2026-09-16 14:14:46.299922102 +0000 UTC m=+5.593610582"
Sep 16 14:14:46.704518 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:46.704429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:46.704518 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:46.704498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:46.704782 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:46.704655    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:14:46.704782 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:46.704718    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs podName:593aebe3-f161-4db4-98a5-611d40cb8bc4 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:50.704698049 +0000 UTC m=+9.998386528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs") pod "network-metrics-daemon-cpn5j" (UID: "593aebe3-f161-4db4-98a5-611d40cb8bc4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:14:46.705160 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:46.705138    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:14:46.705257 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:46.705198    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret podName:8630dc8c-6050-4063-9fd3-d5f0b96683d2 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:50.705183136 +0000 UTC m=+9.998871600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret") pod "global-pull-secret-syncer-2k2x2" (UID: "8630dc8c-6050-4063-9fd3-d5f0b96683d2") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:14:46.906323 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:46.906283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6slxc\" (UniqueName: \"kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc\") pod \"network-check-target-km9bl\" (UID: \"39e55065-d817-4754-8d8a-82da3c8be530\") " pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:46.906530 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:46.906497    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:14:46.906530 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:46.906519    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:14:46.906530 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:46.906531    2582 projected.go:196] Error preparing data for projected volume kube-api-access-6slxc for pod openshift-network-diagnostics/network-check-target-km9bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:14:46.906687 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:46.906589    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc podName:39e55065-d817-4754-8d8a-82da3c8be530 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:50.90657208 +0000 UTC m=+10.200260552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6slxc" (UniqueName: "kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc") pod "network-check-target-km9bl" (UID: "39e55065-d817-4754-8d8a-82da3c8be530") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:14:47.174842 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:47.174696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:47.174842 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:47.174696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:47.174842 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:47.174835    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:14:47.175059 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:47.174851    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:47.175059 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:47.174963    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:14:47.175119 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:47.175053    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:14:49.174263 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:49.174216    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:49.174263 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:49.174256    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:49.174850 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:49.174355    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:49.174850 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:49.174358    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:14:49.174850 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:49.174451    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:14:49.174850 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:49.174526    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:14:50.735811 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:50.735770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:50.736297 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:50.735846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:50.736297 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:50.735902    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:14:50.736297 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:50.735929    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:14:50.736297 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:50.735995    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret podName:8630dc8c-6050-4063-9fd3-d5f0b96683d2 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:58.735953486 +0000 UTC m=+18.029641956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret") pod "global-pull-secret-syncer-2k2x2" (UID: "8630dc8c-6050-4063-9fd3-d5f0b96683d2") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:14:50.736297 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:50.736015    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs podName:593aebe3-f161-4db4-98a5-611d40cb8bc4 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:58.736005053 +0000 UTC m=+18.029693511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs") pod "network-metrics-daemon-cpn5j" (UID: "593aebe3-f161-4db4-98a5-611d40cb8bc4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:14:50.937224 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:50.937194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6slxc\" (UniqueName: \"kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc\") pod \"network-check-target-km9bl\" (UID: \"39e55065-d817-4754-8d8a-82da3c8be530\") " pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:50.937434 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:50.937413    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:14:50.937495 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:50.937440    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:14:50.937495 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:50.937455    2582 projected.go:196] Error preparing data for projected volume kube-api-access-6slxc for pod openshift-network-diagnostics/network-check-target-km9bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:14:50.937574 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:50.937518    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc podName:39e55065-d817-4754-8d8a-82da3c8be530 nodeName:}" failed. No retries permitted until 2026-09-16 14:14:58.937498419 +0000 UTC m=+18.231186892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6slxc" (UniqueName: "kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc") pod "network-check-target-km9bl" (UID: "39e55065-d817-4754-8d8a-82da3c8be530") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:14:51.175594 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:51.175060    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:51.175594 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:51.175157    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:51.175594 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:51.175174    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:14:51.175594 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:51.175230    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:51.175594 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:51.175356    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:14:51.175594 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:51.175513    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:14:53.174065 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:53.174029    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:53.174531 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:53.174192    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:14:53.174644 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:53.174620    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:53.174750 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:53.174728    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:14:53.174803 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:53.174794    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:53.174906 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:53.174883    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:14:55.174479 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:55.174444    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:55.174885 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:55.174444    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:55.174885 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:55.174581    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:14:55.174885 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:55.174604    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:55.174885 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:55.174699    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:14:55.174885 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:55.174808    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:14:57.174012 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:57.173983    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:57.174012 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:57.174008    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:57.174553 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:57.173980    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:57.174553 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:57.174114    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:14:57.174553 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:57.174210    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:14:57.174553 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:57.174301    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:14:58.796451 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:58.796213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:58.796917 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:58.796480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:58.796917 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:58.796392    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:14:58.796917 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:58.796613    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret podName:8630dc8c-6050-4063-9fd3-d5f0b96683d2 nodeName:}" failed. No retries permitted until 2026-09-16 14:15:14.796582144 +0000 UTC m=+34.090270607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret") pod "global-pull-secret-syncer-2k2x2" (UID: "8630dc8c-6050-4063-9fd3-d5f0b96683d2") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:14:58.796917 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:58.796661    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:14:58.796917 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:58.796723    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs podName:593aebe3-f161-4db4-98a5-611d40cb8bc4 nodeName:}" failed. No retries permitted until 2026-09-16 14:15:14.796706135 +0000 UTC m=+34.090394617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs") pod "network-metrics-daemon-cpn5j" (UID: "593aebe3-f161-4db4-98a5-611d40cb8bc4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:14:58.997574 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:58.997537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6slxc\" (UniqueName: \"kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc\") pod \"network-check-target-km9bl\" (UID: \"39e55065-d817-4754-8d8a-82da3c8be530\") " pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:58.997759 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:58.997737    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:14:58.997811 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:58.997767    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:14:58.997811 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:58.997782    2582 projected.go:196] Error preparing data for projected volume kube-api-access-6slxc for pod openshift-network-diagnostics/network-check-target-km9bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:14:58.997876 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:58.997850    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc podName:39e55065-d817-4754-8d8a-82da3c8be530 nodeName:}" failed. No retries permitted until 2026-09-16 14:15:14.997832024 +0000 UTC m=+34.291520500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6slxc" (UniqueName: "kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc") pod "network-check-target-km9bl" (UID: "39e55065-d817-4754-8d8a-82da3c8be530") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:14:59.174223 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:59.174143    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:14:59.174223 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:59.174158    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:14:59.174452 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:14:59.174309    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:14:59.174452 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:59.174309    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:14:59.174452 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:59.174424    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:14:59.174607 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:14:59.174508    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:15:01.175083 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:01.175048    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:01.175526 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:01.175142    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:01.175526 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:01.175170    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:01.175526 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:01.175192    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:15:01.175526 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:01.175262    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:15:01.175526 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:01.175327    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:15:02.303643 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.303398    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5" event={"ID":"5f37dbc7-344e-46ec-969e-fb4f7afb4efa","Type":"ContainerStarted","Data":"82a94d8448fc8259957d07ad5300c76d0b08014929482fc1e74ef5897b3357ce"}
Sep 16 14:15:02.304322 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.303687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5" event={"ID":"5f37dbc7-344e-46ec-969e-fb4f7afb4efa","Type":"ContainerStarted","Data":"f8cfe85eb6db9211b4848283b74a199f56e62e91cdc2395ab7c030e89c46bd7f"}
Sep 16 14:15:02.304322 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.303737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5" event={"ID":"5f37dbc7-344e-46ec-969e-fb4f7afb4efa","Type":"ContainerStarted","Data":"0a6edcef57cd67d2745d1bc709169d69252f3fcb746562056c55fd2afbe2960f"}
Sep 16 14:15:02.304322 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.303784    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5" event={"ID":"5f37dbc7-344e-46ec-969e-fb4f7afb4efa","Type":"ContainerStarted","Data":"f58f3adadf2e6ddf1d3673c42e61d87b788d7b5fde28cf3991be839ce63c6e51"}
Sep 16 14:15:02.304322 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.303824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5" event={"ID":"5f37dbc7-344e-46ec-969e-fb4f7afb4efa","Type":"ContainerStarted","Data":"3cf9781bb4763d6ace943d5bc78bb298c4ac88db35aae96ce2f37b6f6fcedb84"}
Sep 16 14:15:02.304322 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.303863    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5" event={"ID":"5f37dbc7-344e-46ec-969e-fb4f7afb4efa","Type":"ContainerStarted","Data":"e4f41eb3e565bdb7f4c16f455196d450ac924c32772d1c84a577bfc952f4f1ba"}
Sep 16 14:15:02.304848 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.304827    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wdv2g" event={"ID":"c8a90e22-bb92-4813-bb0a-45a8d926b3b4","Type":"ContainerStarted","Data":"8942adc6d42ba95611e1c378598cbf94332476596d513e68424972e9b625e9ce"}
Sep 16 14:15:02.306178 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.306156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pt6kn" event={"ID":"4f28ab05-ab08-4680-bbf3-217236c89965","Type":"ContainerStarted","Data":"999bcc86c958efc33ff833d7dcf97ee75409d1dc38ef45b0b6d10a2c3ea54745"}
Sep 16 14:15:02.307431 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.307407    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cj9ct" event={"ID":"e14f017f-8f29-427c-8791-536d0c01b024","Type":"ContainerStarted","Data":"16253ed83ae4415d0c8c29522185b13cb6f6abf0cbcef1b34cfa8c421137fea8"}
Sep 16 14:15:02.308887 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.308866    2582 generic.go:356] "Generic (PLEG): container finished" podID="8701a4fe-ab7c-45af-af75-0e6dfbeccc78" containerID="1eb6a792d26ad199ba6896e2e909829bfbb30bb4a2a384061c18a3c2738bed8d" exitCode=0
Sep 16 14:15:02.308965 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.308918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2tnp" event={"ID":"8701a4fe-ab7c-45af-af75-0e6dfbeccc78","Type":"ContainerDied","Data":"1eb6a792d26ad199ba6896e2e909829bfbb30bb4a2a384061c18a3c2738bed8d"}
Sep 16 14:15:02.310379 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.310369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jr5mz" event={"ID":"9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08","Type":"ContainerStarted","Data":"4f798ad6ce4bea5f166bc3062885ce8ca381540c2fc3edaa5bc5e0ffc34bd7b8"}
Sep 16 14:15:02.311859 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.311841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96" event={"ID":"a028f488-a7a9-4066-bde6-f83e53817ac5","Type":"ContainerStarted","Data":"6903445be9f47b64cb21acf3d85a495777604fb7e90500e7312e884814882d30"}
Sep 16 14:15:02.313113 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.313095    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dwfhh" event={"ID":"2092b9b3-0313-44ff-982e-e9f0f67a955e","Type":"ContainerStarted","Data":"934e3c6da157a62b34d1d9724a6f168ac5cf0686e31f7648657a9be13b21b391"}
Sep 16 14:15:02.326101 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.326064    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wdv2g" podStartSLOduration=4.221636141 podStartE2EDuration="21.326053149s" totalImagesPullingTime="17.104417008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:02.325593665 +0000 UTC m=+21.619282145" watchObservedRunningTime="2026-09-16 14:15:02.326053149 +0000 UTC m=+21.619741624"
Sep 16 14:15:02.342051 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.342011    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jr5mz" podStartSLOduration=8.139862596 podStartE2EDuration="21.341994952s" totalImagesPullingTime="13.202132356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:02.34099706 +0000 UTC m=+21.634685539" watchObservedRunningTime="2026-09-16 14:15:02.341994952 +0000 UTC m=+21.635683431"
Sep 16 14:15:02.382688 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.382647    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dwfhh" podStartSLOduration=4.333480573 podStartE2EDuration="21.382637164s" totalImagesPullingTime="17.049156591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:02.382341331 +0000 UTC m=+21.676029810" watchObservedRunningTime="2026-09-16 14:15:02.382637164 +0000 UTC m=+21.676325644"
Sep 16 14:15:02.409925 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.409889    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pt6kn" podStartSLOduration=8.207767479 podStartE2EDuration="21.409877831s" totalImagesPullingTime="13.202110352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:02.409281663 +0000 UTC m=+21.702970142" watchObservedRunningTime="2026-09-16 14:15:02.409877831 +0000 UTC m=+21.703566310"
Sep 16 14:15:02.442753 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.442715    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cj9ct" podStartSLOduration=4.39357739 podStartE2EDuration="21.442704662s" totalImagesPullingTime="17.049127272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:02.442417333 +0000 UTC m=+21.736105811" watchObservedRunningTime="2026-09-16 14:15:02.442704662 +0000 UTC m=+21.736393141"
Sep 16 14:15:02.498626 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.498595    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:02.688872 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.688830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:02.859695 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.859668    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dwfhh"
Sep 16 14:15:02.860335 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:02.860308    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dwfhh"
Sep 16 14:15:03.174677 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:03.174645    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:03.174796 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:03.174645    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:03.174796 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:03.174775    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:03.174911 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:03.174770    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:15:03.174966 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:03.174924    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:15:03.175030 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:03.175009    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:15:03.221283 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:03.221262    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 14:15:03.316624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:03.316594    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nkrwr" event={"ID":"c650c79a-d593-409f-86ab-794fd1232d28","Type":"ContainerStarted","Data":"db34567eb6f2b3ceb72287f148a8712f31077be58cb42bfb2fb2e36634cee6c1"}
Sep 16 14:15:03.318388 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:03.318362    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96" event={"ID":"a028f488-a7a9-4066-bde6-f83e53817ac5","Type":"ContainerStarted","Data":"e1dde7cf2699297b656e45207a6c48032239d0edca896bab8f741c1c25dcc39d"}
Sep 16 14:15:03.335396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:03.335361    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nkrwr" podStartSLOduration=5.295087592 podStartE2EDuration="22.335348486s" totalImagesPullingTime="17.040260894s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:03.335248415 +0000 UTC m=+22.628936886" watchObservedRunningTime="2026-09-16 14:15:03.335348486 +0000 UTC m=+22.629036964"
Sep 16 14:15:03.463170 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:03.463095    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:03.583465 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:03.583433    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:04.122355 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:04.122251    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T14:15:03.221279504Z","UUID":"d09d7bce-0576-4df6-a6d7-c21a8296b972","Handler":null,"Name":"","Endpoint":""}
Sep 16 14:15:04.123580 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:04.123562    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 14:15:04.123678 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:04.123591    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 14:15:04.323919 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:04.323826    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 16 14:15:04.323919 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:04.323831    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5" event={"ID":"5f37dbc7-344e-46ec-969e-fb4f7afb4efa","Type":"ContainerStarted","Data":"78a4f2fc6896e729df6306742837f87cad75a876a36509b2232036ac72c6fd7b"}
Sep 16 14:15:05.174874 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:05.174256    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:05.174874 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:05.174396    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:15:05.174874 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:05.174255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:05.174874 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:05.174834    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:15:05.176133 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:05.175045    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:05.176133 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:05.175210    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:15:06.330018 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:06.329979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96" event={"ID":"a028f488-a7a9-4066-bde6-f83e53817ac5","Type":"ContainerStarted","Data":"a52566d3c60c87f890be70efe84aa1641805d3322007231a6bf5daaff7ca7a85"}
Sep 16 14:15:06.352636 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:06.352553    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kv96" podStartSLOduration=4.743864694 podStartE2EDuration="25.352534704s" totalImagesPullingTime="20.60867001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:14:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:06.352066275 +0000 UTC m=+25.645754753" watchObservedRunningTime="2026-09-16 14:15:06.352534704 +0000 UTC m=+25.646223183"
Sep 16 14:15:07.177616 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:07.177584    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:07.177786 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:07.177688    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:07.177786 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:07.177700    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:15:07.177786 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:07.177722    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:07.177939 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:07.177823    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:15:07.177939 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:07.177904    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:15:07.976077 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:07.975923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:08.059011 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:08.058985    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:08.226144 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:08.226036    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:08.323813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:08.323785    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:08.338624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:08.338596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5" event={"ID":"5f37dbc7-344e-46ec-969e-fb4f7afb4efa","Type":"ContainerStarted","Data":"6433a245e00c225766ebfa5f5f9c3733024d14fda57f92055219977f4888bf0f"}
Sep 16 14:15:08.338957 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:08.338821    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:15:08.338957 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:08.338883    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:15:08.340639 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:08.340613    2582 generic.go:356] "Generic (PLEG): container finished" podID="8701a4fe-ab7c-45af-af75-0e6dfbeccc78" containerID="895756016b6b1a0700da2184cd7aa87ba603b9e9765bae8d24de57f4adc554a3" exitCode=0
Sep 16 14:15:08.340736 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:08.340650    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2tnp" event={"ID":"8701a4fe-ab7c-45af-af75-0e6dfbeccc78","Type":"ContainerDied","Data":"895756016b6b1a0700da2184cd7aa87ba603b9e9765bae8d24de57f4adc554a3"}
Sep 16 14:15:08.354066 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:08.354047    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:15:08.372551 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:08.372516    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5" podStartSLOduration=10.270311472 podStartE2EDuration="27.372503694s" totalImagesPullingTime="17.102192222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:08.372424903 +0000 UTC m=+27.666113394" watchObservedRunningTime="2026-09-16 14:15:08.372503694 +0000 UTC m=+27.666192172"
Sep 16 14:15:09.173970 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:09.173931    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:09.173970 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:09.173949    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:09.174617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:09.174045    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:09.174617 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:09.174056    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:15:09.174617 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:09.174117    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:15:09.174617 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:09.174205    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:15:09.343914 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:09.343880    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:15:09.361359 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:09.361336    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:15:09.580348 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:09.580313    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2k2x2"]
Sep 16 14:15:09.580518 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:09.580406    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:09.580518 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:09.580493    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:15:09.583039 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:09.583016    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-km9bl"]
Sep 16 14:15:09.583172 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:09.583097    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:09.583255 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:09.583175    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:15:09.598046 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:09.598018    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cpn5j"]
Sep 16 14:15:09.598186 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:09.598171    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:09.598354 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:09.598334    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:15:11.174665 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:11.174435    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:11.175052 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:11.174496    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:11.175052 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:11.174683    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:15:11.175052 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:11.174516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:11.175052 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:11.174771    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:15:11.175052 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:11.174860    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:15:11.349468 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:11.349439    2582 generic.go:356] "Generic (PLEG): container finished" podID="8701a4fe-ab7c-45af-af75-0e6dfbeccc78" containerID="cdfb43c7b2bf6d765142f1874398b2e9da89b5a0724204af2aa0e3b459de6d69" exitCode=0
Sep 16 14:15:11.349623 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:11.349516    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2tnp" event={"ID":"8701a4fe-ab7c-45af-af75-0e6dfbeccc78","Type":"ContainerDied","Data":"cdfb43c7b2bf6d765142f1874398b2e9da89b5a0724204af2aa0e3b459de6d69"}
Sep 16 14:15:11.369775 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:11.369754    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dwfhh"
Sep 16 14:15:11.369908 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:11.369891    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 16 14:15:11.370406 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:11.370388    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dwfhh"
Sep 16 14:15:11.441081 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:11.441010    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:12.281768 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:12.281737    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:12.355207 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:12.355179    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2tnp" event={"ID":"8701a4fe-ab7c-45af-af75-0e6dfbeccc78","Type":"ContainerStarted","Data":"816a421470e71b8c9bc8ffb9c2867d8fc8ea841e9d7967d2e55c03e7293d6a4a"}
Sep 16 14:15:12.382985 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:12.382949    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:12.886206 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:12.886169    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:12.964906 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:12.964871    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:13.142559 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:13.142486    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:13.174457 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:13.174431    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:13.174457 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:13.174431    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:13.174615 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:13.174431    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:13.174615 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:13.174538    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpn5j" podUID="593aebe3-f161-4db4-98a5-611d40cb8bc4"
Sep 16 14:15:13.174718 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:13.174654    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k2x2" podUID="8630dc8c-6050-4063-9fd3-d5f0b96683d2"
Sep 16 14:15:13.174769 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:13.174722    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-km9bl" podUID="39e55065-d817-4754-8d8a-82da3c8be530"
Sep 16 14:15:13.234877 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:13.234844    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:13.298368 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:13.298335    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:13.359079 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:13.359052    2582 generic.go:356] "Generic (PLEG): container finished" podID="8701a4fe-ab7c-45af-af75-0e6dfbeccc78" containerID="816a421470e71b8c9bc8ffb9c2867d8fc8ea841e9d7967d2e55c03e7293d6a4a" exitCode=0
Sep 16 14:15:13.359171 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:13.359101    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2tnp" event={"ID":"8701a4fe-ab7c-45af-af75-0e6dfbeccc78","Type":"ContainerDied","Data":"816a421470e71b8c9bc8ffb9c2867d8fc8ea841e9d7967d2e55c03e7293d6a4a"}
Sep 16 14:15:13.594659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:13.594631    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:13.657801 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:13.657774    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:13.830820 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:13.830793    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:13.921163 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:13.921106    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:14.238606 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.238584    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jr5mz_9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08/dns-node-resolver/0.log"
Sep 16 14:15:14.450229 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.450171    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-137.ec2.internal" event="NodeReady"
Sep 16 14:15:14.450578 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.450298    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 14:15:14.506195 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.506172    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hq5tx"]
Sep 16 14:15:14.532101 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.532081    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mxsbq"]
Sep 16 14:15:14.532213 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.532202    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:14.534796 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.534779    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 14:15:14.534888 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.534829    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 14:15:14.534888 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.534842    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9f4mh\""
Sep 16 14:15:14.553014 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.552991    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hq5tx"]
Sep 16 14:15:14.553110 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.553021    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mxsbq"]
Sep 16 14:15:14.553110 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.553105    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.555983 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.555925    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 14:15:14.555983 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.555938    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 14:15:14.556134 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.555993    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 14:15:14.556226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.556213    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qst7x\""
Sep 16 14:15:14.556302 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.556289    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 14:15:14.607123 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.607098    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tpsrx"]
Sep 16 14:15:14.626511 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.626490    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tpsrx"]
Sep 16 14:15:14.626598 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.626494    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tpsrx"
Sep 16 14:15:14.629091 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.629072    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xnd4l\""
Sep 16 14:15:14.629091 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.629085    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 14:15:14.629251 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.629206    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 14:15:14.629303 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.629257    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 14:15:14.713216 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.713148    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05e7c2ce-ab6b-4c76-b055-53114e2c5442-config-volume\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:14.713216 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.713177    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsn4p\" (UniqueName: \"kubernetes.io/projected/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-api-access-wsn4p\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.713385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.713217    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05e7c2ce-ab6b-4c76-b055-53114e2c5442-tmp-dir\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:14.713385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.713310    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22b34b53-183b-496b-8e0a-a559bc0c7e82-cert\") pod \"ingress-canary-tpsrx\" (UID: \"22b34b53-183b-496b-8e0a-a559bc0c7e82\") " pod="openshift-ingress-canary/ingress-canary-tpsrx"
Sep 16 14:15:14.713385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.713346    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6z9h\" (UniqueName: \"kubernetes.io/projected/22b34b53-183b-496b-8e0a-a559bc0c7e82-kube-api-access-f6z9h\") pod \"ingress-canary-tpsrx\" (UID: \"22b34b53-183b-496b-8e0a-a559bc0c7e82\") " pod="openshift-ingress-canary/ingress-canary-tpsrx"
Sep 16 14:15:14.713385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.713364    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8grsj\" (UniqueName: \"kubernetes.io/projected/05e7c2ce-ab6b-4c76-b055-53114e2c5442-kube-api-access-8grsj\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:14.713523 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.713403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58d50368-0c00-4a2f-ad15-b20e44df5bec-crio-socket\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.713523 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.713419    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.713523 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.713437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d50368-0c00-4a2f-ad15-b20e44df5bec-data-volume\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.713523 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.713462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:14.713523 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.713504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.814501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:14.814501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05e7c2ce-ab6b-4c76-b055-53114e2c5442-tmp-dir\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:14.814738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814528    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22b34b53-183b-496b-8e0a-a559bc0c7e82-cert\") pod \"ingress-canary-tpsrx\" (UID: \"22b34b53-183b-496b-8e0a-a559bc0c7e82\") " pod="openshift-ingress-canary/ingress-canary-tpsrx"
Sep 16 14:15:14.814738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6z9h\" (UniqueName: \"kubernetes.io/projected/22b34b53-183b-496b-8e0a-a559bc0c7e82-kube-api-access-f6z9h\") pod \"ingress-canary-tpsrx\" (UID: \"22b34b53-183b-496b-8e0a-a559bc0c7e82\") " pod="openshift-ingress-canary/ingress-canary-tpsrx"
Sep 16 14:15:14.814738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814590    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8grsj\" (UniqueName: \"kubernetes.io/projected/05e7c2ce-ab6b-4c76-b055-53114e2c5442-kube-api-access-8grsj\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:14.814738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:14.814738 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:14.814639    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:15:14.814738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58d50368-0c00-4a2f-ad15-b20e44df5bec-crio-socket\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.814738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.814738 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:14.814725    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret podName:8630dc8c-6050-4063-9fd3-d5f0b96683d2 nodeName:}" failed. No retries permitted until 2026-09-16 14:15:46.814704537 +0000 UTC m=+66.108393002 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret") pod "global-pull-secret-syncer-2k2x2" (UID: "8630dc8c-6050-4063-9fd3-d5f0b96683d2") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:14.814745    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:14.814767    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:14.814807    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs podName:593aebe3-f161-4db4-98a5-611d40cb8bc4 nodeName:}" failed. No retries permitted until 2026-09-16 14:15:46.814791411 +0000 UTC m=+66.108479879 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs") pod "network-metrics-daemon-cpn5j" (UID: "593aebe3-f161-4db4-98a5-611d40cb8bc4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:14.814826    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls podName:58d50368-0c00-4a2f-ad15-b20e44df5bec nodeName:}" failed. No retries permitted until 2026-09-16 14:15:15.314816239 +0000 UTC m=+34.608504710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxsbq" (UID: "58d50368-0c00-4a2f-ad15-b20e44df5bec") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814852    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d50368-0c00-4a2f-ad15-b20e44df5bec-data-volume\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814880    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05e7c2ce-ab6b-4c76-b055-53114e2c5442-tmp-dir\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:14.814939    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814958    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58d50368-0c00-4a2f-ad15-b20e44df5bec-crio-socket\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:14.814973    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls podName:05e7c2ce-ab6b-4c76-b055-53114e2c5442 nodeName:}" failed. No retries permitted until 2026-09-16 14:15:15.314962187 +0000 UTC m=+34.608650644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls") pod "dns-default-hq5tx" (UID: "05e7c2ce-ab6b-4c76-b055-53114e2c5442") : secret "dns-default-metrics-tls" not found
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.814960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:14.815002    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.815017    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05e7c2ce-ab6b-4c76-b055-53114e2c5442-config-volume\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:14.815111    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm podName:58d50368-0c00-4a2f-ad15-b20e44df5bec nodeName:}" failed. No retries permitted until 2026-09-16 14:15:15.315097463 +0000 UTC m=+34.608785937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxsbq" (UID: "58d50368-0c00-4a2f-ad15-b20e44df5bec") : configmap "kube-rbac-proxy" not found
Sep 16 14:15:14.815136 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.815141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsn4p\" (UniqueName: \"kubernetes.io/projected/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-api-access-wsn4p\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.815681 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.815259    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d50368-0c00-4a2f-ad15-b20e44df5bec-data-volume\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.815681 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.815533    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05e7c2ce-ab6b-4c76-b055-53114e2c5442-config-volume\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:14.818875 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.818764    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22b34b53-183b-496b-8e0a-a559bc0c7e82-cert\") pod \"ingress-canary-tpsrx\" (UID: \"22b34b53-183b-496b-8e0a-a559bc0c7e82\") " pod="openshift-ingress-canary/ingress-canary-tpsrx"
Sep 16 14:15:14.829412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.829388    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8grsj\" (UniqueName: \"kubernetes.io/projected/05e7c2ce-ab6b-4c76-b055-53114e2c5442-kube-api-access-8grsj\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:14.830030 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.830013    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6z9h\" (UniqueName: \"kubernetes.io/projected/22b34b53-183b-496b-8e0a-a559bc0c7e82-kube-api-access-f6z9h\") pod \"ingress-canary-tpsrx\" (UID: \"22b34b53-183b-496b-8e0a-a559bc0c7e82\") " pod="openshift-ingress-canary/ingress-canary-tpsrx"
Sep 16 14:15:14.830210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.830188    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsn4p\" (UniqueName: \"kubernetes.io/projected/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-api-access-wsn4p\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:14.861271 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.861221    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-pb4xw"]
Sep 16 14:15:14.881637 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.881617    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-pb4xw"]
Sep 16 14:15:14.881716 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.881707    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-pb4xw"
Sep 16 14:15:14.884399 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.884382    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 16 14:15:14.884566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.884415    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 16 14:15:14.884566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.884534    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6f9kf\""
Sep 16 14:15:14.934876 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.934853    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tpsrx"
Sep 16 14:15:14.945817 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:14.945798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:15.004722 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.004642    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:15.016783 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.016751    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fb7v\" (UniqueName: \"kubernetes.io/projected/f68b9992-3859-43cb-84b5-df1a83fb2b38-kube-api-access-9fb7v\") pod \"migrator-8b4d697c5-pb4xw\" (UID: \"f68b9992-3859-43cb-84b5-df1a83fb2b38\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-pb4xw"
Sep 16 14:15:15.016925 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.016887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6slxc\" (UniqueName: \"kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc\") pod \"network-check-target-km9bl\" (UID: \"39e55065-d817-4754-8d8a-82da3c8be530\") " pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:15.017045 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:15.017027    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:15:15.017130 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:15.017052    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:15:15.017130 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:15.017062    2582 projected.go:196] Error preparing data for projected volume kube-api-access-6slxc for pod openshift-network-diagnostics/network-check-target-km9bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:15:15.017130 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:15.017115    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc podName:39e55065-d817-4754-8d8a-82da3c8be530 nodeName:}" failed. No retries permitted until 2026-09-16 14:15:47.017099532 +0000 UTC m=+66.310788003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6slxc" (UniqueName: "kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc") pod "network-check-target-km9bl" (UID: "39e55065-d817-4754-8d8a-82da3c8be530") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:15:15.118209 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.118182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fb7v\" (UniqueName: \"kubernetes.io/projected/f68b9992-3859-43cb-84b5-df1a83fb2b38-kube-api-access-9fb7v\") pod \"migrator-8b4d697c5-pb4xw\" (UID: \"f68b9992-3859-43cb-84b5-df1a83fb2b38\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-pb4xw"
Sep 16 14:15:15.128083 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.128063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fb7v\" (UniqueName: \"kubernetes.io/projected/f68b9992-3859-43cb-84b5-df1a83fb2b38-kube-api-access-9fb7v\") pod \"migrator-8b4d697c5-pb4xw\" (UID: \"f68b9992-3859-43cb-84b5-df1a83fb2b38\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-pb4xw"
Sep 16 14:15:15.177466 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.177440    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:15.177563 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.177474    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:15.177563 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.177553    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:15.180415 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.180390    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 14:15:15.180494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.180438    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 14:15:15.180543 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.180503    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 14:15:15.180615 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.180597    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-999gw\""
Sep 16 14:15:15.180680 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.180667    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 14:15:15.180855 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.180843    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8dcj9\""
Sep 16 14:15:15.189772 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.189754    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-pb4xw"
Sep 16 14:15:15.241517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.241487    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tpsrx"]
Sep 16 14:15:15.244987 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:15:15.244956    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b34b53_183b_496b_8e0a_a559bc0c7e82.slice/crio-006989d0d23aadf0731e69d4f181e80fb2641a3dc0e86e89c4df1cfd94cb511f WatchSource:0}: Error finding container 006989d0d23aadf0731e69d4f181e80fb2641a3dc0e86e89c4df1cfd94cb511f: Status 404 returned error can't find the container with id 006989d0d23aadf0731e69d4f181e80fb2641a3dc0e86e89c4df1cfd94cb511f
Sep 16 14:15:15.320665 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.320635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:15.320784 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.320674    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:15.320784 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.320735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:15.320870 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:15.320802    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:15:15.320870 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:15.320817    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:15:15.320870 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:15.320862    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls podName:05e7c2ce-ab6b-4c76-b055-53114e2c5442 nodeName:}" failed. No retries permitted until 2026-09-16 14:15:16.320844001 +0000 UTC m=+35.614532475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls") pod "dns-default-hq5tx" (UID: "05e7c2ce-ab6b-4c76-b055-53114e2c5442") : secret "dns-default-metrics-tls" not found
Sep 16 14:15:15.320979 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:15.320875    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm podName:58d50368-0c00-4a2f-ad15-b20e44df5bec nodeName:}" failed. No retries permitted until 2026-09-16 14:15:16.320869398 +0000 UTC m=+35.614557854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxsbq" (UID: "58d50368-0c00-4a2f-ad15-b20e44df5bec") : configmap "kube-rbac-proxy" not found
Sep 16 14:15:15.320979 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:15.320912    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:15:15.320979 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:15.320951    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls podName:58d50368-0c00-4a2f-ad15-b20e44df5bec nodeName:}" failed. No retries permitted until 2026-09-16 14:15:16.320934589 +0000 UTC m=+35.614623060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxsbq" (UID: "58d50368-0c00-4a2f-ad15-b20e44df5bec") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:15:15.363966 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.363942    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tpsrx" event={"ID":"22b34b53-183b-496b-8e0a-a559bc0c7e82","Type":"ContainerStarted","Data":"006989d0d23aadf0731e69d4f181e80fb2641a3dc0e86e89c4df1cfd94cb511f"}
Sep 16 14:15:15.480364 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.480337    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-pb4xw"]
Sep 16 14:15:15.484484 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:15:15.484460    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf68b9992_3859_43cb_84b5_df1a83fb2b38.slice/crio-73ce0d7b12e9d5333665e03bbe7c55b57e389fa6f8eebbedf00514d6ebb1ac0e WatchSource:0}: Error finding container 73ce0d7b12e9d5333665e03bbe7c55b57e389fa6f8eebbedf00514d6ebb1ac0e: Status 404 returned error can't find the container with id 73ce0d7b12e9d5333665e03bbe7c55b57e389fa6f8eebbedf00514d6ebb1ac0e
Sep 16 14:15:15.637447 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:15.637427    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pt6kn_4f28ab05-ab08-4680-bbf3-217236c89965/node-ca/0.log"
Sep 16 14:15:16.013107 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:16.013045    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:16.328551 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:16.328520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:16.328823 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:16.328574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:16.328823 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:16.328662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:16.328823 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:16.328674    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:15:16.328823 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:16.328727    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:15:16.328823 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:16.328753    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls podName:05e7c2ce-ab6b-4c76-b055-53114e2c5442 nodeName:}" failed. No retries permitted until 2026-09-16 14:15:18.328732371 +0000 UTC m=+37.622420844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls") pod "dns-default-hq5tx" (UID: "05e7c2ce-ab6b-4c76-b055-53114e2c5442") : secret "dns-default-metrics-tls" not found
Sep 16 14:15:16.328823 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:16.328783    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm podName:58d50368-0c00-4a2f-ad15-b20e44df5bec nodeName:}" failed. No retries permitted until 2026-09-16 14:15:18.328766362 +0000 UTC m=+37.622454832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxsbq" (UID: "58d50368-0c00-4a2f-ad15-b20e44df5bec") : configmap "kube-rbac-proxy" not found
Sep 16 14:15:16.328823 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:16.328799    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:15:16.329110 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:16.328850    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls podName:58d50368-0c00-4a2f-ad15-b20e44df5bec nodeName:}" failed. No retries permitted until 2026-09-16 14:15:18.328835866 +0000 UTC m=+37.622524336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxsbq" (UID: "58d50368-0c00-4a2f-ad15-b20e44df5bec") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:15:16.369622 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:16.369596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-pb4xw" event={"ID":"f68b9992-3859-43cb-84b5-df1a83fb2b38","Type":"ContainerStarted","Data":"73ce0d7b12e9d5333665e03bbe7c55b57e389fa6f8eebbedf00514d6ebb1ac0e"}
Sep 16 14:15:16.706640 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:16.706530    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:16.971631 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:16.971554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:17.375356 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:17.375011    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-pb4xw" event={"ID":"f68b9992-3859-43cb-84b5-df1a83fb2b38","Type":"ContainerStarted","Data":"97da194a6fa69d62c3b2a03d0a2d97a7704f94345e59700c1809aee2085d96b4"}
Sep 16 14:15:17.375356 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:17.375312    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-pb4xw" event={"ID":"f68b9992-3859-43cb-84b5-df1a83fb2b38","Type":"ContainerStarted","Data":"9e027ba69cb3a4d8898bbf3113f8c2c4665b2e115e0e20cc0bab82b86ad9d36f"}
Sep 16 14:15:17.528718 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:17.528635    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:17.681396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:17.681353    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:17.774965 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:17.774920    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:17.994686 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:17.994641    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:18.273461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:18.273359    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:18.344516 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:18.344486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:18.344684 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:18.344534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:18.344684 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:18.344624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:18.344684 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:18.344634    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:15:18.344861 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:18.344690    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:15:18.344861 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:18.344711    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:15:18.344861 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:18.344695    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls podName:05e7c2ce-ab6b-4c76-b055-53114e2c5442 nodeName:}" failed. No retries permitted until 2026-09-16 14:15:22.344676648 +0000 UTC m=+41.638365117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls") pod "dns-default-hq5tx" (UID: "05e7c2ce-ab6b-4c76-b055-53114e2c5442") : secret "dns-default-metrics-tls" not found
Sep 16 14:15:18.344861 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:18.344763    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm podName:58d50368-0c00-4a2f-ad15-b20e44df5bec nodeName:}" failed. No retries permitted until 2026-09-16 14:15:22.344742302 +0000 UTC m=+41.638430766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxsbq" (UID: "58d50368-0c00-4a2f-ad15-b20e44df5bec") : configmap "kube-rbac-proxy" not found
Sep 16 14:15:18.344861 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:18.344783    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls podName:58d50368-0c00-4a2f-ad15-b20e44df5bec nodeName:}" failed. No retries permitted until 2026-09-16 14:15:22.344776139 +0000 UTC m=+41.638464596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxsbq" (UID: "58d50368-0c00-4a2f-ad15-b20e44df5bec") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:15:19.383141 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:19.383053    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tpsrx" event={"ID":"22b34b53-183b-496b-8e0a-a559bc0c7e82","Type":"ContainerStarted","Data":"369efea902602c09df184a74270ba7633bf1a15fa05a1f54dacb498f19849056"}
Sep 16 14:15:19.401576 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:19.401516    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tpsrx" podStartSLOduration=1.5200278900000002 podStartE2EDuration="5.401493739s" totalImagesPullingTime="3.881465849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:19.400809212 +0000 UTC m=+38.694497694" watchObservedRunningTime="2026-09-16 14:15:19.401493739 +0000 UTC m=+38.695182216"
Sep 16 14:15:19.402108 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:19.402075    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-pb4xw" podStartSLOduration=3.851783475 podStartE2EDuration="5.4020607s" totalImagesPullingTime="1.550277225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:17.411085492 +0000 UTC m=+36.704773973" watchObservedRunningTime="2026-09-16 14:15:19.4020607 +0000 UTC m=+38.695749181"
Sep 16 14:15:19.433875 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:19.433841    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:19.534972 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:19.534935    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:19.634949 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:19.634880    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:19.696378 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:19.696349    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:19.829211 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:19.829177    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:20.051279 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:20.051230    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:20.227988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:20.227954    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:20.876850 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:20.876809    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:21.028869 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:21.028838    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:21.223188 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:21.223118    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:21.290340 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:21.290312    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:21.628373 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:21.628349    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:22.157804 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:22.157774    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:22.259186 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:22.259155    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:22.376077 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:22.376026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:22.376270 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:22.376142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:22.376270 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:22.376153    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:15:22.376270 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:22.376174    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:22.376270 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:22.376212    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm podName:58d50368-0c00-4a2f-ad15-b20e44df5bec nodeName:}" failed. No retries permitted until 2026-09-16 14:15:30.376197617 +0000 UTC m=+49.669886090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxsbq" (UID: "58d50368-0c00-4a2f-ad15-b20e44df5bec") : configmap "kube-rbac-proxy" not found
Sep 16 14:15:22.376476 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:22.376320    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:15:22.376476 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:15:22.376385    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls podName:58d50368-0c00-4a2f-ad15-b20e44df5bec nodeName:}" failed. No retries permitted until 2026-09-16 14:15:30.376366942 +0000 UTC m=+49.670055412 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxsbq" (UID: "58d50368-0c00-4a2f-ad15-b20e44df5bec") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:15:22.379400 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:22.379373    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05e7c2ce-ab6b-4c76-b055-53114e2c5442-metrics-tls\") pod \"dns-default-hq5tx\" (UID: \"05e7c2ce-ab6b-4c76-b055-53114e2c5442\") " pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:22.393763 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:22.393743    2582 generic.go:356] "Generic (PLEG): container finished" podID="8701a4fe-ab7c-45af-af75-0e6dfbeccc78" containerID="eef68a7fa161d1a3a1a08487dd40938a7a9022600a3bf9103f5a984102c1ceef" exitCode=0
Sep 16 14:15:22.393857 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:22.393795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2tnp" event={"ID":"8701a4fe-ab7c-45af-af75-0e6dfbeccc78","Type":"ContainerDied","Data":"eef68a7fa161d1a3a1a08487dd40938a7a9022600a3bf9103f5a984102c1ceef"}
Sep 16 14:15:22.621727 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:22.621691    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:22.641703 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:22.641679    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:22.916943 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:22.916914    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hq5tx"]
Sep 16 14:15:22.921975 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:15:22.920382    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e7c2ce_ab6b_4c76_b055_53114e2c5442.slice/crio-48ce6ad43eb4b1fe0b134ceb7de36e6fc0ed8b54711a5bcd96f8b45c4b92c4fa WatchSource:0}: Error finding container 48ce6ad43eb4b1fe0b134ceb7de36e6fc0ed8b54711a5bcd96f8b45c4b92c4fa: Status 404 returned error can't find the container with id 48ce6ad43eb4b1fe0b134ceb7de36e6fc0ed8b54711a5bcd96f8b45c4b92c4fa
Sep 16 14:15:23.173225 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:23.173196    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:23.274964 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:23.274938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:23.397419 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:23.397390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hq5tx" event={"ID":"05e7c2ce-ab6b-4c76-b055-53114e2c5442","Type":"ContainerStarted","Data":"48ce6ad43eb4b1fe0b134ceb7de36e6fc0ed8b54711a5bcd96f8b45c4b92c4fa"}
Sep 16 14:15:23.400270 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:23.400226    2582 generic.go:356] "Generic (PLEG): container finished" podID="8701a4fe-ab7c-45af-af75-0e6dfbeccc78" containerID="48d46b9ff2142bf4f39ab7d69e94c2d5f0d3af5582ac9a055f20a580a3959a74" exitCode=0
Sep 16 14:15:23.400270 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:23.400262    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2tnp" event={"ID":"8701a4fe-ab7c-45af-af75-0e6dfbeccc78","Type":"ContainerDied","Data":"48d46b9ff2142bf4f39ab7d69e94c2d5f0d3af5582ac9a055f20a580a3959a74"}
Sep 16 14:15:23.633478 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:23.633445    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:24.406792 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:24.406740    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2tnp" event={"ID":"8701a4fe-ab7c-45af-af75-0e6dfbeccc78","Type":"ContainerStarted","Data":"5d8aee8a0705a5ddaafb14d7f3a61e5d131a691c05147625152111f6ba523b6b"}
Sep 16 14:15:24.433207 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:24.433156    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f2tnp" podStartSLOduration=9.523932071 podStartE2EDuration="43.433139723s" totalImagesPullingTime="33.909207652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:14:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:24.431868757 +0000 UTC m=+43.725557236" watchObservedRunningTime="2026-09-16 14:15:24.433139723 +0000 UTC m=+43.726828203"
Sep 16 14:15:24.942942 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:24.942914    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:25.044581 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:25.044554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:25.226069 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:25.226040    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:25.410392 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:25.410364    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hq5tx" event={"ID":"05e7c2ce-ab6b-4c76-b055-53114e2c5442","Type":"ContainerStarted","Data":"e46e6c58fdc3110dd8b3b3dd32df8f8d63c9a324d0c4f28b4f529ec20ec1b6a2"}
Sep 16 14:15:25.627320 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:25.627287    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:26.010940 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:26.010854    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:26.414397 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:26.414370    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hq5tx" event={"ID":"05e7c2ce-ab6b-4c76-b055-53114e2c5442","Type":"ContainerStarted","Data":"2e6a04014bac7eb1775f9bf7f1b1f06b790c076d6ceec71f4b7eea73b4ab68df"}
Sep 16 14:15:26.414749 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:26.414483    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:26.432139 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:26.432096    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hq5tx" podStartSLOduration=10.180583254 podStartE2EDuration="12.432084595s" totalImagesPullingTime="2.251501341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:26.431856624 +0000 UTC m=+45.725545108" watchObservedRunningTime="2026-09-16 14:15:26.432084595 +0000 UTC m=+45.725773074"
Sep 16 14:15:26.437068 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:26.437044    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:26.667418 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:26.667344    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:27.022700 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:27.022608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:27.235170 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:27.235141    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:27.625313 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:27.625280    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:28.038918 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:28.038893    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:28.120105 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:28.120080    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:28.221975 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:28.221949    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:28.327515 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:28.327456    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:30.436741 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:30.436713    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:30.437085 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:30.436757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:30.437360 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:30.437342    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d50368-0c00-4a2f-ad15-b20e44df5bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:30.438924 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:30.438905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d50368-0c00-4a2f-ad15-b20e44df5bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxsbq\" (UID: \"58d50368-0c00-4a2f-ad15-b20e44df5bec\") " pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:30.460896 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:30.460876    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mxsbq"
Sep 16 14:15:30.731459 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:30.731371    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mxsbq"]
Sep 16 14:15:30.735100 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:15:30.735076    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d50368_0c00_4a2f_ad15_b20e44df5bec.slice/crio-4676ca3062e8cc642022b0c748032e3acae7d951aec80efddb72a5e9817db349 WatchSource:0}: Error finding container 4676ca3062e8cc642022b0c748032e3acae7d951aec80efddb72a5e9817db349: Status 404 returned error can't find the container with id 4676ca3062e8cc642022b0c748032e3acae7d951aec80efddb72a5e9817db349
Sep 16 14:15:31.427384 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:31.427351    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mxsbq" event={"ID":"58d50368-0c00-4a2f-ad15-b20e44df5bec","Type":"ContainerStarted","Data":"60640d830a81bd453594fd323b6c98313b8b723060f575cc2a0b324c1b668770"}
Sep 16 14:15:31.427543 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:31.427404    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mxsbq" event={"ID":"58d50368-0c00-4a2f-ad15-b20e44df5bec","Type":"ContainerStarted","Data":"4676ca3062e8cc642022b0c748032e3acae7d951aec80efddb72a5e9817db349"}
Sep 16 14:15:32.392556 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:32.392520    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:32.493124 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:32.493096    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:32.704978 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:32.704882    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:33.070431 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:33.070385    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:33.438947 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:33.438862    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mxsbq" event={"ID":"58d50368-0c00-4a2f-ad15-b20e44df5bec","Type":"ContainerStarted","Data":"ab790bc5eca3fb24b8f56ff9d476375981ee305956ddd484be77492e27149d3f"}
Sep 16 14:15:33.467539 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:33.467503    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:33.666342 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:33.666302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:33.735102 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:33.735024    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:33.878487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:33.878446    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:34.111175 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:34.111143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:34.281675 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:34.281648    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:34.421666 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:34.421586    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:34.443890 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:34.443859    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mxsbq" event={"ID":"58d50368-0c00-4a2f-ad15-b20e44df5bec","Type":"ContainerStarted","Data":"27769e888122ed77e35091e2e83ba967ca7f98c61986f50d0318e939bc2af9dd"}
Sep 16 14:15:34.464407 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:34.464354    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mxsbq" podStartSLOduration=17.381555432 podStartE2EDuration="20.464334552s" totalImagesPullingTime="3.08277912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:15:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:34.46279579 +0000 UTC m=+53.756484267" watchObservedRunningTime="2026-09-16 14:15:34.464334552 +0000 UTC m=+53.758023031"
Sep 16 14:15:35.300959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.300932    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:35.694410 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.694339    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj"]
Sep 16 14:15:35.696590 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.696570    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj"
Sep 16 14:15:35.699150 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.699124    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 16 14:15:35.699589 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.699567    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 16 14:15:35.699702 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.699621    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 16 14:15:35.699702 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.699662    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"]
Sep 16 14:15:35.700342 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.700321    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bxf4f\""
Sep 16 14:15:35.700472 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.700396    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 16 14:15:35.701591 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.701573    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.704054 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.704036    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 16 14:15:35.704503 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.704482    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 16 14:15:35.704612 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.704598    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 16 14:15:35.705782 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.705766    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 16 14:15:35.724381 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.724360    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj"]
Sep 16 14:15:35.732723 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.732700    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"]
Sep 16 14:15:35.773499 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.773479    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6c59226b-213a-4b0c-80de-ae83f73b8d8d-ca\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.773598 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.773507    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c59226b-213a-4b0c-80de-ae83f73b8d8d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.773598 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.773534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6c59226b-213a-4b0c-80de-ae83f73b8d8d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.773598 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.773556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbx2z\" (UniqueName: \"kubernetes.io/projected/6c59226b-213a-4b0c-80de-ae83f73b8d8d-kube-api-access-tbx2z\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.773700 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.773635    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6c59226b-213a-4b0c-80de-ae83f73b8d8d-hub\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.773700 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.773685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxr6p\" (UniqueName: \"kubernetes.io/projected/c12ebbb4-d383-4757-8ff1-a6df7332b819-kube-api-access-dxr6p\") pod \"managed-serviceaccount-addon-agent-5d64694c78-vp2rj\" (UID: \"c12ebbb4-d383-4757-8ff1-a6df7332b819\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj"
Sep 16 14:15:35.773774 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.773710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c12ebbb4-d383-4757-8ff1-a6df7332b819-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d64694c78-vp2rj\" (UID: \"c12ebbb4-d383-4757-8ff1-a6df7332b819\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj"
Sep 16 14:15:35.773774 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.773732    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c59226b-213a-4b0c-80de-ae83f73b8d8d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.826878 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.826849    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:35.873985 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.873960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c12ebbb4-d383-4757-8ff1-a6df7332b819-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d64694c78-vp2rj\" (UID: \"c12ebbb4-d383-4757-8ff1-a6df7332b819\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj"
Sep 16 14:15:35.874103 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.873988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c59226b-213a-4b0c-80de-ae83f73b8d8d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.874103 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.874028    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6c59226b-213a-4b0c-80de-ae83f73b8d8d-ca\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.874210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.874134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c59226b-213a-4b0c-80de-ae83f73b8d8d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.874210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.874185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6c59226b-213a-4b0c-80de-ae83f73b8d8d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.874339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.874209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbx2z\" (UniqueName: \"kubernetes.io/projected/6c59226b-213a-4b0c-80de-ae83f73b8d8d-kube-api-access-tbx2z\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.874339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.874261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6c59226b-213a-4b0c-80de-ae83f73b8d8d-hub\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.874339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.874314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxr6p\" (UniqueName: \"kubernetes.io/projected/c12ebbb4-d383-4757-8ff1-a6df7332b819-kube-api-access-dxr6p\") pod \"managed-serviceaccount-addon-agent-5d64694c78-vp2rj\" (UID: \"c12ebbb4-d383-4757-8ff1-a6df7332b819\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj"
Sep 16 14:15:35.874791 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.874768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c59226b-213a-4b0c-80de-ae83f73b8d8d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.876864 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.876841    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6c59226b-213a-4b0c-80de-ae83f73b8d8d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.876949 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.876906    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c12ebbb4-d383-4757-8ff1-a6df7332b819-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d64694c78-vp2rj\" (UID: \"c12ebbb4-d383-4757-8ff1-a6df7332b819\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj"
Sep 16 14:15:35.877050 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.877028    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6c59226b-213a-4b0c-80de-ae83f73b8d8d-ca\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.877090 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.877074    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c59226b-213a-4b0c-80de-ae83f73b8d8d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.877127 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.877114    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6c59226b-213a-4b0c-80de-ae83f73b8d8d-hub\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.901960 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.901937    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxr6p\" (UniqueName: \"kubernetes.io/projected/c12ebbb4-d383-4757-8ff1-a6df7332b819-kube-api-access-dxr6p\") pod \"managed-serviceaccount-addon-agent-5d64694c78-vp2rj\" (UID: \"c12ebbb4-d383-4757-8ff1-a6df7332b819\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj"
Sep 16 14:15:35.902037 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.902006    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbx2z\" (UniqueName: \"kubernetes.io/projected/6c59226b-213a-4b0c-80de-ae83f73b8d8d-kube-api-access-tbx2z\") pod \"cluster-proxy-proxy-agent-6b754548bb-5jq29\" (UID: \"6c59226b-213a-4b0c-80de-ae83f73b8d8d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:35.941003 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:35.940974    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:36.015529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:36.015475    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj"
Sep 16 14:15:36.019991 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:36.019977    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"
Sep 16 14:15:36.028846 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:36.028824    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:36.301028 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:36.301001    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj"]
Sep 16 14:15:36.305986 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:15:36.305952    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc12ebbb4_d383_4757_8ff1_a6df7332b819.slice/crio-18ee86ada31810838ce5d8c9354ed30932e2b18bfca876a340fb0d7c63bc1aed WatchSource:0}: Error finding container 18ee86ada31810838ce5d8c9354ed30932e2b18bfca876a340fb0d7c63bc1aed: Status 404 returned error can't find the container with id 18ee86ada31810838ce5d8c9354ed30932e2b18bfca876a340fb0d7c63bc1aed
Sep 16 14:15:36.312012 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:36.310445    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29"]
Sep 16 14:15:36.419018 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:36.418992    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hq5tx"
Sep 16 14:15:36.450724 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:36.450698    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29" event={"ID":"6c59226b-213a-4b0c-80de-ae83f73b8d8d","Type":"ContainerStarted","Data":"4d4a741d915704360e0dfed4f83d29bd7c4ba423d5160060d48c1ca7f6b8136d"}
Sep 16 14:15:36.451796 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:36.451770    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj" event={"ID":"c12ebbb4-d383-4757-8ff1-a6df7332b819","Type":"ContainerStarted","Data":"18ee86ada31810838ce5d8c9354ed30932e2b18bfca876a340fb0d7c63bc1aed"}
Sep 16 14:15:38.468773 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:38.468711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:38.543822 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:38.543787    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:38.615713 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:38.615676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:41.365487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:41.365466    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mgd5"
Sep 16 14:15:41.474434 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:41.474400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj" event={"ID":"c12ebbb4-d383-4757-8ff1-a6df7332b819","Type":"ContainerStarted","Data":"4c23e9a4cdc650f9d228e6b6077761607430e44ce5ae13da1e6b5b967eb79810"}
Sep 16 14:15:41.476582 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:41.476560    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29" event={"ID":"6c59226b-213a-4b0c-80de-ae83f73b8d8d","Type":"ContainerStarted","Data":"24f7b4ce3111c8ee8750b55e94c051e17f5bac753d7727955ea6795386f80d8b"}
Sep 16 14:15:41.476676 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:41.476592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29" event={"ID":"6c59226b-213a-4b0c-80de-ae83f73b8d8d","Type":"ContainerStarted","Data":"2468430bed5c38891dcfd1b2f3513d683d162158876accaddabd66d2377145c1"}
Sep 16 14:15:41.476676 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:41.476604    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29" event={"ID":"6c59226b-213a-4b0c-80de-ae83f73b8d8d","Type":"ContainerStarted","Data":"70373200b97e67ac23b353e6d8cf28f4e769ed57dfb62d8d45547ef602983681"}
Sep 16 14:15:41.495397 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:41.495353    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d64694c78-vp2rj" podStartSLOduration=1.675516035 podStartE2EDuration="6.495337817s" totalImagesPullingTime="4.819821782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:41.495010659 +0000 UTC m=+60.788699139" watchObservedRunningTime="2026-09-16 14:15:41.495337817 +0000 UTC m=+60.789026295"
Sep 16 14:15:41.515127 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:41.515089    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b754548bb-5jq29" podStartSLOduration=1.712706325 podStartE2EDuration="6.515075402s" totalImagesPullingTime="4.802369077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:41.514031196 +0000 UTC m=+60.807719687" watchObservedRunningTime="2026-09-16 14:15:41.515075402 +0000 UTC m=+60.808763881"
Sep 16 14:15:41.813221 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:41.813186    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:41.914779 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:41.914744    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:44.437913 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:44.437879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:44.534046 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:44.534016    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:44.603801 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:44.603759    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:44.853701 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:44.853665    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:45.517765 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:45.517736    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:45.574325 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:45.574300    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:46.320335 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:46.320305    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:46.421044 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:46.421017    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:46.855302 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:46.855270    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:46.855650 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:46.855317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:46.858152 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:46.858135    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 14:15:46.859014 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:46.858998    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 14:15:46.868162 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:46.868133    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8630dc8c-6050-4063-9fd3-d5f0b96683d2-original-pull-secret\") pod \"global-pull-secret-syncer-2k2x2\" (UID: \"8630dc8c-6050-4063-9fd3-d5f0b96683d2\") " pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:46.868162 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:46.868161    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593aebe3-f161-4db4-98a5-611d40cb8bc4-metrics-certs\") pod \"network-metrics-daemon-cpn5j\" (UID: \"593aebe3-f161-4db4-98a5-611d40cb8bc4\") " pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:46.987988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:46.987959    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k2x2"
Sep 16 14:15:47.000511 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.000487    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-999gw\""
Sep 16 14:15:47.008554 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.008532    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpn5j"
Sep 16 14:15:47.057194 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.057158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6slxc\" (UniqueName: \"kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc\") pod \"network-check-target-km9bl\" (UID: \"39e55065-d817-4754-8d8a-82da3c8be530\") " pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:47.060484 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.060460    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 14:15:47.071345 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.071322    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 14:15:47.082799 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.082779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6slxc\" (UniqueName: \"kubernetes.io/projected/39e55065-d817-4754-8d8a-82da3c8be530-kube-api-access-6slxc\") pod \"network-check-target-km9bl\" (UID: \"39e55065-d817-4754-8d8a-82da3c8be530\") " pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:47.257912 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.257843    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2k2x2"]
Sep 16 14:15:47.261113 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:15:47.261086    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8630dc8c_6050_4063_9fd3_d5f0b96683d2.slice/crio-fcbb98eff3d6c6578cc755650d8a8006904245e7f09fc487858406d7318e086e WatchSource:0}: Error finding container fcbb98eff3d6c6578cc755650d8a8006904245e7f09fc487858406d7318e086e: Status 404 returned error can't find the container with id fcbb98eff3d6c6578cc755650d8a8006904245e7f09fc487858406d7318e086e
Sep 16 14:15:47.283064 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.283043    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cpn5j"]
Sep 16 14:15:47.287360 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:15:47.287339    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593aebe3_f161_4db4_98a5_611d40cb8bc4.slice/crio-aca079d16f61d34ff1a18cd67454fc475bc2c2b3253d9c43a0b6bb6cb061907a WatchSource:0}: Error finding container aca079d16f61d34ff1a18cd67454fc475bc2c2b3253d9c43a0b6bb6cb061907a: Status 404 returned error can't find the container with id aca079d16f61d34ff1a18cd67454fc475bc2c2b3253d9c43a0b6bb6cb061907a
Sep 16 14:15:47.295607 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.295587    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8dcj9\""
Sep 16 14:15:47.303837 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.303818    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:47.496617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.496585    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cpn5j" event={"ID":"593aebe3-f161-4db4-98a5-611d40cb8bc4","Type":"ContainerStarted","Data":"aca079d16f61d34ff1a18cd67454fc475bc2c2b3253d9c43a0b6bb6cb061907a"}
Sep 16 14:15:47.497713 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.497679    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2k2x2" event={"ID":"8630dc8c-6050-4063-9fd3-d5f0b96683d2","Type":"ContainerStarted","Data":"fcbb98eff3d6c6578cc755650d8a8006904245e7f09fc487858406d7318e086e"}
Sep 16 14:15:47.567248 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:47.567205    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-km9bl"]
Sep 16 14:15:47.570526 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:15:47.570502    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e55065_d817_4754_8d8a_82da3c8be530.slice/crio-1b3c400b7e1c647c830e0da4c88f22fc2456e0e138d02a3c6718e74504ec643f WatchSource:0}: Error finding container 1b3c400b7e1c647c830e0da4c88f22fc2456e0e138d02a3c6718e74504ec643f: Status 404 returned error can't find the container with id 1b3c400b7e1c647c830e0da4c88f22fc2456e0e138d02a3c6718e74504ec643f
Sep 16 14:15:48.504981 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:48.504878    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cpn5j" event={"ID":"593aebe3-f161-4db4-98a5-611d40cb8bc4","Type":"ContainerStarted","Data":"10a834b4627550c1c083fe0766f8b50051f67d4ffeedfb0f69813776f46abe23"}
Sep 16 14:15:48.506439 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:48.506407    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-km9bl" event={"ID":"39e55065-d817-4754-8d8a-82da3c8be530","Type":"ContainerStarted","Data":"1b3c400b7e1c647c830e0da4c88f22fc2456e0e138d02a3c6718e74504ec643f"}
Sep 16 14:15:49.513509 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:49.513466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cpn5j" event={"ID":"593aebe3-f161-4db4-98a5-611d40cb8bc4","Type":"ContainerStarted","Data":"2879bc84ac2f92be6529accfcfda3ae4a6233422a3b363fafa4ed9edb700aa75"}
Sep 16 14:15:49.531784 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:49.531740    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cpn5j" podStartSLOduration=67.485092064 podStartE2EDuration="1m8.531721453s" totalImagesPullingTime="1.046629389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:49.530819692 +0000 UTC m=+68.824508171" watchObservedRunningTime="2026-09-16 14:15:49.531721453 +0000 UTC m=+68.825409933"
Sep 16 14:15:49.542556 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:49.542528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:49.612187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:49.612159    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:49.701035 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:49.700987    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:49.776873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:49.776795    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:49.929326 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:49.929292    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:52.526374 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:52.526274    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-km9bl" event={"ID":"39e55065-d817-4754-8d8a-82da3c8be530","Type":"ContainerStarted","Data":"75a082c08584409e976ee5103d3311753d6512aa0aa926c7c8e81a4789ed934d"}
Sep 16 14:15:52.526755 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:52.526371    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:15:52.527745 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:52.527723    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2k2x2" event={"ID":"8630dc8c-6050-4063-9fd3-d5f0b96683d2","Type":"ContainerStarted","Data":"65849f24d5340f56ea26ae264283ef445b28752e8efd56e9e45cd65d7f193b5d"}
Sep 16 14:15:52.543952 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:52.543903    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-km9bl" podStartSLOduration=66.907272617 podStartE2EDuration="1m11.543887569s" totalImagesPullingTime="4.636614952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:52.543211373 +0000 UTC m=+71.836899857" watchObservedRunningTime="2026-09-16 14:15:52.543887569 +0000 UTC m=+71.837576049"
Sep 16 14:15:52.559328 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:52.559287    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2k2x2" podStartSLOduration=66.609763903 podStartE2EDuration="1m11.559274026s" totalImagesPullingTime="4.949510123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:52.558859492 +0000 UTC m=+71.852547973" watchObservedRunningTime="2026-09-16 14:15:52.559274026 +0000 UTC m=+71.852962532"
Sep 16 14:15:53.070205 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:53.070172    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:53.171767 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:53.171732    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:54.797434 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:54.797404    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:55.154604 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.154532    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6wdrj"]
Sep 16 14:15:55.184134 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.184106    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.188221 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.188196    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 14:15:55.188424 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.188404    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-njn57\""
Sep 16 14:15:55.188501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.188408    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 14:15:55.188565 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.188518    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 14:15:55.189458 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.189441    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 14:15:55.189544 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.189482    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 14:15:55.189596 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.189551    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 14:15:55.316304 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.316279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c4be10b-96f4-4feb-83f7-4f80df5668b7-sys\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.316304 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.316305    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c4be10b-96f4-4feb-83f7-4f80df5668b7-root\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.316481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.316327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c4be10b-96f4-4feb-83f7-4f80df5668b7-metrics-client-ca\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.316481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.316345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.316481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.316428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-wtmp\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.316481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.316457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.316647 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.316491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-textfile\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.316647 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.316511    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24ptt\" (UniqueName: \"kubernetes.io/projected/4c4be10b-96f4-4feb-83f7-4f80df5668b7-kube-api-access-24ptt\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.316647 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.316571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-tls\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417127    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-wtmp\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-textfile\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417381 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24ptt\" (UniqueName: \"kubernetes.io/projected/4c4be10b-96f4-4feb-83f7-4f80df5668b7-kube-api-access-24ptt\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417381 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417322    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-wtmp\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417381 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-tls\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417382    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c4be10b-96f4-4feb-83f7-4f80df5668b7-sys\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c4be10b-96f4-4feb-83f7-4f80df5668b7-root\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417457    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c4be10b-96f4-4feb-83f7-4f80df5668b7-sys\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417467    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c4be10b-96f4-4feb-83f7-4f80df5668b7-root\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c4be10b-96f4-4feb-83f7-4f80df5668b7-metrics-client-ca\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417781 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-textfile\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.417966 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.417949    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c4be10b-96f4-4feb-83f7-4f80df5668b7-metrics-client-ca\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.418105 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.418083    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.419485 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.419465    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.419711 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.419691    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c4be10b-96f4-4feb-83f7-4f80df5668b7-node-exporter-tls\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.438493 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.438470    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24ptt\" (UniqueName: \"kubernetes.io/projected/4c4be10b-96f4-4feb-83f7-4f80df5668b7-kube-api-access-24ptt\") pod \"node-exporter-6wdrj\" (UID: \"4c4be10b-96f4-4feb-83f7-4f80df5668b7\") " pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.493512 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.493492    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6wdrj"
Sep 16 14:15:55.521301 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:15:55.521275    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4be10b_96f4_4feb_83f7_4f80df5668b7.slice/crio-c65b3b93bbbb43b39a05bea6f6f15b4ee04ae1fe5ce4a9e0ee0b8f01b2c5cef6 WatchSource:0}: Error finding container c65b3b93bbbb43b39a05bea6f6f15b4ee04ae1fe5ce4a9e0ee0b8f01b2c5cef6: Status 404 returned error can't find the container with id c65b3b93bbbb43b39a05bea6f6f15b4ee04ae1fe5ce4a9e0ee0b8f01b2c5cef6
Sep 16 14:15:55.536925 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.536903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wdrj" event={"ID":"4c4be10b-96f4-4feb-83f7-4f80df5668b7","Type":"ContainerStarted","Data":"c65b3b93bbbb43b39a05bea6f6f15b4ee04ae1fe5ce4a9e0ee0b8f01b2c5cef6"}
Sep 16 14:15:55.549335 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.549317    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:55.651297 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.651271    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:55.807497 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.807469    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:55.906140 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:55.906114    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:56.101021 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:56.100922    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:56.198572 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:56.198540    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:56.305521 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:56.305489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:57.547584 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:57.547546    2582 generic.go:356] "Generic (PLEG): container finished" podID="4c4be10b-96f4-4feb-83f7-4f80df5668b7" containerID="8ddf3868b16dca83963159056497d6fa4fd7c86029853172c38e82e5ae545ea2" exitCode=0
Sep 16 14:15:57.548065 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:57.547591    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wdrj" event={"ID":"4c4be10b-96f4-4feb-83f7-4f80df5668b7","Type":"ContainerDied","Data":"8ddf3868b16dca83963159056497d6fa4fd7c86029853172c38e82e5ae545ea2"}
Sep 16 14:15:58.057022 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.056998    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:58.132158 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.132133    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-df5b668f7-rmq9g"]
Sep 16 14:15:58.134681 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.134658    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.137564 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.137484    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 16 14:15:58.137564 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.137539    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 16 14:15:58.137775 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.137598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:58.137775 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.137615    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5u7ehee106l96\""
Sep 16 14:15:58.137775 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.137653    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 16 14:15:58.137906 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.137823    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xjsc2\""
Sep 16 14:15:58.137952 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.137908    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 16 14:15:58.138047 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.138032    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 16 14:15:58.152503 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.152473    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-df5b668f7-rmq9g"]
Sep 16 14:15:58.207281 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.207251    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:58.238307 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.238284    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.238387 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.238310    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-grpc-tls\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.238387 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.238330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.238387 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.238350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea71fb0-a3f9-4861-bf41-b352242ba29a-metrics-client-ca\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.238513 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.238417    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.238550 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.238520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjs6g\" (UniqueName: \"kubernetes.io/projected/1ea71fb0-a3f9-4861-bf41-b352242ba29a-kube-api-access-mjs6g\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.238581 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.238552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-tls\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.238620 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.238581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.339463 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.339397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.339463 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.339450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjs6g\" (UniqueName: \"kubernetes.io/projected/1ea71fb0-a3f9-4861-bf41-b352242ba29a-kube-api-access-mjs6g\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.339619 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.339485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-tls\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.339619 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.339520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.339619 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.339556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.339619 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.339585    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-grpc-tls\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.339840 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.339619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.339840 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.339658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea71fb0-a3f9-4861-bf41-b352242ba29a-metrics-client-ca\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.340502 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.340452    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea71fb0-a3f9-4861-bf41-b352242ba29a-metrics-client-ca\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.342393 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.342366    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.342501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.342477    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.342575 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.342560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.342803 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.342782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-tls\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.342897 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.342836    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-grpc-tls\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.343033 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.343011    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea71fb0-a3f9-4861-bf41-b352242ba29a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.350273 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.350206    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjs6g\" (UniqueName: \"kubernetes.io/projected/1ea71fb0-a3f9-4861-bf41-b352242ba29a-kube-api-access-mjs6g\") pod \"thanos-querier-df5b668f7-rmq9g\" (UID: \"1ea71fb0-a3f9-4861-bf41-b352242ba29a\") " pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.444135 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.444103    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:15:58.552651 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.552619    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wdrj" event={"ID":"4c4be10b-96f4-4feb-83f7-4f80df5668b7","Type":"ContainerStarted","Data":"76e81fec49e93f1b45a773e048551fbed1daee0075f8c2bac9716b1dbecc1822"}
Sep 16 14:15:58.553074 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.552675    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wdrj" event={"ID":"4c4be10b-96f4-4feb-83f7-4f80df5668b7","Type":"ContainerStarted","Data":"cc39f43657f20da335cb93c6eeb5c7caa912da77e60bacd2810a2ee92396f268"}
Sep 16 14:15:58.575378 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.575332    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6wdrj" podStartSLOduration=2.449380753 podStartE2EDuration="3.575316075s" totalImagesPullingTime="1.065859084s" totalInitContainerRuntime="60.076238ms" isStatefulPod=true podCreationTimestamp="2026-09-16 14:15:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:15:58.574221645 +0000 UTC m=+77.867910145" watchObservedRunningTime="2026-09-16 14:15:58.575316075 +0000 UTC m=+77.869004553"
Sep 16 14:15:58.733732 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.733656    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-df5b668f7-rmq9g"]
Sep 16 14:15:58.735935 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:15:58.735907    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea71fb0_a3f9_4861_bf41_b352242ba29a.slice/crio-abae9ca252142df5f5169fb635d742d2f4551c5f8e605d6cb927a904e74ee9cb WatchSource:0}: Error finding container abae9ca252142df5f5169fb635d742d2f4551c5f8e605d6cb927a904e74ee9cb: Status 404 returned error can't find the container with id abae9ca252142df5f5169fb635d742d2f4551c5f8e605d6cb927a904e74ee9cb
Sep 16 14:15:58.853628 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.853595    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:58.947540 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:58.947504    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:59.557479 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:59.557441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g" event={"ID":"1ea71fb0-a3f9-4861-bf41-b352242ba29a","Type":"ContainerStarted","Data":"abae9ca252142df5f5169fb635d742d2f4551c5f8e605d6cb927a904e74ee9cb"}
Sep 16 14:15:59.850214 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:59.850132    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:15:59.944902 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:15:59.944869    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:00.546597 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.546566    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:00.751929 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.751885    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b7c454499-krgp4"]
Sep 16 14:16:00.754397 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.754378    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.757012 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.756980    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 14:16:00.757132 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.757012    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 14:16:00.758004 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.757984    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 14:16:00.758164 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.758145    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 14:16:00.758335 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.758206    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gqfcf\""
Sep 16 14:16:00.758335 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.758255    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 14:16:00.758498 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.758478    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 14:16:00.758600 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.758519    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 14:16:00.763002 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.762691    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 14:16:00.765802 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.765781    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7c454499-krgp4"]
Sep 16 14:16:00.860222 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.860134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-service-ca\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.860222 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.860189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-oauth-serving-cert\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.860451 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.860228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-oauth-config\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.860451 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.860268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj2gz\" (UniqueName: \"kubernetes.io/projected/da91a8ec-9bf6-42e2-84ba-fe51afce6649-kube-api-access-tj2gz\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.860451 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.860350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-config\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.860451 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.860398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-serving-cert\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.860451 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.860428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-trusted-ca-bundle\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.961464 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.961430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-serving-cert\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.961649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.961473    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-trusted-ca-bundle\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.961649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.961507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-service-ca\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.961649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.961548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-oauth-serving-cert\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.961649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.961583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-oauth-config\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.961649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.961608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj2gz\" (UniqueName: \"kubernetes.io/projected/da91a8ec-9bf6-42e2-84ba-fe51afce6649-kube-api-access-tj2gz\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.961649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.961650    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-config\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.962486 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.962384    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-service-ca\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.962486 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.962442    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-config\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.962660 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.962489    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-trusted-ca-bundle\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.962930 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.962903    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-oauth-serving-cert\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.964538 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.964491    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-serving-cert\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.964646 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.964559    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-oauth-config\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:00.971791 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:00.971759    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj2gz\" (UniqueName: \"kubernetes.io/projected/da91a8ec-9bf6-42e2-84ba-fe51afce6649-kube-api-access-tj2gz\") pod \"console-6b7c454499-krgp4\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") " pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:01.066254 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:01.066222    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:01.339553 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:01.339525    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7c454499-krgp4"]
Sep 16 14:16:01.343250 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:16:01.343209    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda91a8ec_9bf6_42e2_84ba_fe51afce6649.slice/crio-fed0405885543b1e796f6a0104f2bdb3cbde8bd3b2a4b37579d28465262a8121 WatchSource:0}: Error finding container fed0405885543b1e796f6a0104f2bdb3cbde8bd3b2a4b37579d28465262a8121: Status 404 returned error can't find the container with id fed0405885543b1e796f6a0104f2bdb3cbde8bd3b2a4b37579d28465262a8121
Sep 16 14:16:01.571859 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:01.571818    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g" event={"ID":"1ea71fb0-a3f9-4861-bf41-b352242ba29a","Type":"ContainerStarted","Data":"635452e73607b820d78233df215c1fcfec2686cd49aa0c5101ef62c47b48a713"}
Sep 16 14:16:01.572011 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:01.571916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g" event={"ID":"1ea71fb0-a3f9-4861-bf41-b352242ba29a","Type":"ContainerStarted","Data":"2daf9e95cd54059bfd8f29b20a4a8629cc60f81bb1e7ae62bbad16de50d9c8cb"}
Sep 16 14:16:01.572011 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:01.571962    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g" event={"ID":"1ea71fb0-a3f9-4861-bf41-b352242ba29a","Type":"ContainerStarted","Data":"2f13f1eb40a7a3a6c0f5021709072a206367a546a37b0a49b30376aa81f2b9dd"}
Sep 16 14:16:01.573020 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:01.572997    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7c454499-krgp4" event={"ID":"da91a8ec-9bf6-42e2-84ba-fe51afce6649","Type":"ContainerStarted","Data":"fed0405885543b1e796f6a0104f2bdb3cbde8bd3b2a4b37579d28465262a8121"}
Sep 16 14:16:01.897725 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:01.897644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:02.581015 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:02.580943    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g" event={"ID":"1ea71fb0-a3f9-4861-bf41-b352242ba29a","Type":"ContainerStarted","Data":"557ba4f26a32a99f43c1ac9427b3d9be5a9ae778ccaa944256a8b08f7a149f2b"}
Sep 16 14:16:02.581141 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:02.581109    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g" event={"ID":"1ea71fb0-a3f9-4861-bf41-b352242ba29a","Type":"ContainerStarted","Data":"58c4b5d4cf8154987336e4e8d1341b878b1f31a5fe813e2f9e29ee63f0cc560e"}
Sep 16 14:16:03.590406 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:03.590371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g" event={"ID":"1ea71fb0-a3f9-4861-bf41-b352242ba29a","Type":"ContainerStarted","Data":"595800fbb5dfa58d8d333c0a68ad824fe8f87c21dde797fa5322cad10b5568d2"}
Sep 16 14:16:03.590876 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:03.590541    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:16:03.616482 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:03.616424    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g" podStartSLOduration=2.147040094 podStartE2EDuration="5.616404102s" totalImagesPullingTime="3.469364008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:15:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:16:03.616094539 +0000 UTC m=+82.909783021" watchObservedRunningTime="2026-09-16 14:16:03.616404102 +0000 UTC m=+82.910092575"
Sep 16 14:16:04.595727 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:04.595689    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7c454499-krgp4" event={"ID":"da91a8ec-9bf6-42e2-84ba-fe51afce6649","Type":"ContainerStarted","Data":"b558d963a0e67d43fc6e5bf21e58ba3619990ca6ecd37241b8e11035123f6c82"}
Sep 16 14:16:04.615402 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:04.615341    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b7c454499-krgp4" podStartSLOduration=2.035337202 podStartE2EDuration="4.615325544s" totalImagesPullingTime="2.579988342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:16:04.614415258 +0000 UTC m=+83.908103738" watchObservedRunningTime="2026-09-16 14:16:04.615325544 +0000 UTC m=+83.909014022"
Sep 16 14:16:08.832981 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:08.832953    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:08.901738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:08.901708    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:09.602064 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:09.602037    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-df5b668f7-rmq9g"
Sep 16 14:16:11.066387 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:11.066350    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:11.066876 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:11.066415    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:11.071220 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:11.071198    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:11.624510 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:11.624482    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:16:11.786019 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:11.785979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:11.886751 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:11.886680    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:11.953328 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:11.953294    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:13.205166 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:13.205122    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:13.309874 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:13.309839    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:17.500041 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:17.500003    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:17.560994 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:17.560963    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:21.690750 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:21.690718    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:21.790456 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:21.790430    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:21.851193 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:21.851167    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:22.696445 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:22.696410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:22.775889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:22.775855    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:23.533164 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:23.533128    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-km9bl"
Sep 16 14:16:23.632097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:23.632061    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:23.734997 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:23.734967    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:28.201325 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:28.201291    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:28.263561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:28.263534    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:16:41.074076 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:16:41.074043    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:14.349005 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:14.348974    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:15.077320 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:15.077282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:23.188135 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:23.188094    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:23.252271 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:23.252221    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:23.728801 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:23.728769    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:23.830148 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:23.830116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:25.567024 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:25.566992    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:29.614843 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:29.614807    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:29.710167 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:29.710134    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:35.719609 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:35.719528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:41.567717 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:41.567683    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:41.623692 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:41.623661    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:42.700501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:42.700466    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:42.850300 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:42.850265    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7c454499-krgp4"]
Sep 16 14:17:42.969010 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:42.968941    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:43.034276 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:43.034250    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:47.962789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:47.962753    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:53.172506 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:53.172471    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:53.240249 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:53.240204    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:58.701854 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:58.701823    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:17:59.261013 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:17:59.260978    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:18:07.869047 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:07.868998    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b7c454499-krgp4" podUID="da91a8ec-9bf6-42e2-84ba-fe51afce6649" containerName="console" containerID="cri-o://b558d963a0e67d43fc6e5bf21e58ba3619990ca6ecd37241b8e11035123f6c82" gracePeriod=15
Sep 16 14:18:08.013146 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.013113    2582 generic.go:356] "Generic (PLEG): container finished" podID="da91a8ec-9bf6-42e2-84ba-fe51afce6649" containerID="b558d963a0e67d43fc6e5bf21e58ba3619990ca6ecd37241b8e11035123f6c82" exitCode=0
Sep 16 14:18:08.013363 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.013174    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7c454499-krgp4" event={"ID":"da91a8ec-9bf6-42e2-84ba-fe51afce6649","Type":"ContainerDied","Data":"b558d963a0e67d43fc6e5bf21e58ba3619990ca6ecd37241b8e11035123f6c82"}
Sep 16 14:18:08.106428 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.106404    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:18:08.218379 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.218293    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-trusted-ca-bundle\") pod \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") "
Sep 16 14:18:08.218379 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.218336    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tj2gz\" (UniqueName: \"kubernetes.io/projected/da91a8ec-9bf6-42e2-84ba-fe51afce6649-kube-api-access-tj2gz\") pod \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") "
Sep 16 14:18:08.218379 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.218377    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-service-ca\") pod \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") "
Sep 16 14:18:08.218641 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.218406    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-serving-cert\") pod \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") "
Sep 16 14:18:08.218641 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.218433    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-oauth-config\") pod \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") "
Sep 16 14:18:08.218641 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.218454    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-config\") pod \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") "
Sep 16 14:18:08.218641 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.218494    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-oauth-serving-cert\") pod \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\" (UID: \"da91a8ec-9bf6-42e2-84ba-fe51afce6649\") "
Sep 16 14:18:08.218844 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.218724    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "da91a8ec-9bf6-42e2-84ba-fe51afce6649" (UID: "da91a8ec-9bf6-42e2-84ba-fe51afce6649"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:18:08.218942 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.218915    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-service-ca" (OuterVolumeSpecName: "service-ca") pod "da91a8ec-9bf6-42e2-84ba-fe51afce6649" (UID: "da91a8ec-9bf6-42e2-84ba-fe51afce6649"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:18:08.218998 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.218918    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da91a8ec-9bf6-42e2-84ba-fe51afce6649" (UID: "da91a8ec-9bf6-42e2-84ba-fe51afce6649"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:18:08.219043 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.218989    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-config" (OuterVolumeSpecName: "console-config") pod "da91a8ec-9bf6-42e2-84ba-fe51afce6649" (UID: "da91a8ec-9bf6-42e2-84ba-fe51afce6649"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:18:08.220897 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.220867    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da91a8ec-9bf6-42e2-84ba-fe51afce6649" (UID: "da91a8ec-9bf6-42e2-84ba-fe51afce6649"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:18:08.221175 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.221147    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da91a8ec-9bf6-42e2-84ba-fe51afce6649" (UID: "da91a8ec-9bf6-42e2-84ba-fe51afce6649"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:18:08.221231 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.221173    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da91a8ec-9bf6-42e2-84ba-fe51afce6649-kube-api-access-tj2gz" (OuterVolumeSpecName: "kube-api-access-tj2gz") pod "da91a8ec-9bf6-42e2-84ba-fe51afce6649" (UID: "da91a8ec-9bf6-42e2-84ba-fe51afce6649"). InnerVolumeSpecName "kube-api-access-tj2gz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:18:08.319757 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.319734    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-trusted-ca-bundle\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:18:08.319757 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.319755    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tj2gz\" (UniqueName: \"kubernetes.io/projected/da91a8ec-9bf6-42e2-84ba-fe51afce6649-kube-api-access-tj2gz\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:18:08.319881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.319765    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:18:08.319881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.319774    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-serving-cert\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:18:08.319881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.319782    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-oauth-config\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:18:08.319881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.319790    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-console-config\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:18:08.319881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:08.319797    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da91a8ec-9bf6-42e2-84ba-fe51afce6649-oauth-serving-cert\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:18:09.018878 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:09.018840    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7c454499-krgp4" event={"ID":"da91a8ec-9bf6-42e2-84ba-fe51afce6649","Type":"ContainerDied","Data":"fed0405885543b1e796f6a0104f2bdb3cbde8bd3b2a4b37579d28465262a8121"}
Sep 16 14:18:09.019313 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:09.018900    2582 scope.go:117] "RemoveContainer" containerID="b558d963a0e67d43fc6e5bf21e58ba3619990ca6ecd37241b8e11035123f6c82"
Sep 16 14:18:09.019313 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:09.018863    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7c454499-krgp4"
Sep 16 14:18:09.039017 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:09.038993    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7c454499-krgp4"]
Sep 16 14:18:09.044843 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:09.044817    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b7c454499-krgp4"]
Sep 16 14:18:09.178419 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:09.178386    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da91a8ec-9bf6-42e2-84ba-fe51afce6649" path="/var/lib/kubelet/pods/da91a8ec-9bf6-42e2-84ba-fe51afce6649/volumes"
Sep 16 14:18:23.042330 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:23.042299    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:18:23.140449 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:23.140415    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:18:24.137047 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.137012    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"]
Sep 16 14:18:24.137561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.137387    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da91a8ec-9bf6-42e2-84ba-fe51afce6649" containerName="console"
Sep 16 14:18:24.137561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.137406    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da91a8ec-9bf6-42e2-84ba-fe51afce6649" containerName="console"
Sep 16 14:18:24.137561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.137466    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="da91a8ec-9bf6-42e2-84ba-fe51afce6649" containerName="console"
Sep 16 14:18:24.140189 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.140168    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:24.142993 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.142977    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gdfsj\""
Sep 16 14:18:24.143352 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.143338    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 14:18:24.143911 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.143894    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 14:18:24.150614 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.150596    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"]
Sep 16 14:18:24.223998 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.223972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmrkg\" (UniqueName: \"kubernetes.io/projected/d8153498-42a5-4138-9ff7-4c9a95e0749b-kube-api-access-gmrkg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq\" (UID: \"d8153498-42a5-4138-9ff7-4c9a95e0749b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:24.224123 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.224012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8153498-42a5-4138-9ff7-4c9a95e0749b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq\" (UID: \"d8153498-42a5-4138-9ff7-4c9a95e0749b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:24.224123 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.224083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8153498-42a5-4138-9ff7-4c9a95e0749b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq\" (UID: \"d8153498-42a5-4138-9ff7-4c9a95e0749b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:24.325122 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.325100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmrkg\" (UniqueName: \"kubernetes.io/projected/d8153498-42a5-4138-9ff7-4c9a95e0749b-kube-api-access-gmrkg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq\" (UID: \"d8153498-42a5-4138-9ff7-4c9a95e0749b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:24.325221 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.325129    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8153498-42a5-4138-9ff7-4c9a95e0749b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq\" (UID: \"d8153498-42a5-4138-9ff7-4c9a95e0749b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:24.325221 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.325164    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8153498-42a5-4138-9ff7-4c9a95e0749b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq\" (UID: \"d8153498-42a5-4138-9ff7-4c9a95e0749b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:24.325470 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.325453    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8153498-42a5-4138-9ff7-4c9a95e0749b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq\" (UID: \"d8153498-42a5-4138-9ff7-4c9a95e0749b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:24.325538 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.325500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8153498-42a5-4138-9ff7-4c9a95e0749b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq\" (UID: \"d8153498-42a5-4138-9ff7-4c9a95e0749b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:24.333550 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.333524    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmrkg\" (UniqueName: \"kubernetes.io/projected/d8153498-42a5-4138-9ff7-4c9a95e0749b-kube-api-access-gmrkg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq\" (UID: \"d8153498-42a5-4138-9ff7-4c9a95e0749b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:24.449095 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.449041    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:24.719080 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:24.719059    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"]
Sep 16 14:18:24.721791 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:18:24.721764    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8153498_42a5_4138_9ff7_4c9a95e0749b.slice/crio-0d866ef19cd7a812d8775d8b551038c7c4d03bb7cbd19575818adf86cfc65ca5 WatchSource:0}: Error finding container 0d866ef19cd7a812d8775d8b551038c7c4d03bb7cbd19575818adf86cfc65ca5: Status 404 returned error can't find the container with id 0d866ef19cd7a812d8775d8b551038c7c4d03bb7cbd19575818adf86cfc65ca5
Sep 16 14:18:25.073895 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:25.073857    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq" event={"ID":"d8153498-42a5-4138-9ff7-4c9a95e0749b","Type":"ContainerStarted","Data":"0d866ef19cd7a812d8775d8b551038c7c4d03bb7cbd19575818adf86cfc65ca5"}
Sep 16 14:18:32.098651 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:32.098613    2582 generic.go:356] "Generic (PLEG): container finished" podID="d8153498-42a5-4138-9ff7-4c9a95e0749b" containerID="bc9d9700872c0a34aa2642c8e85a10683754b98cd624ab6ce28be1494c21e775" exitCode=0
Sep 16 14:18:32.099023 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:32.098672    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq" event={"ID":"d8153498-42a5-4138-9ff7-4c9a95e0749b","Type":"ContainerDied","Data":"bc9d9700872c0a34aa2642c8e85a10683754b98cd624ab6ce28be1494c21e775"}
Sep 16 14:18:35.111098 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:35.111065    2582 generic.go:356] "Generic (PLEG): container finished" podID="d8153498-42a5-4138-9ff7-4c9a95e0749b" containerID="82c72a1de055e91a321dec6f7de67a06b7c06816e36578c57d762a3f4ffc4a0c" exitCode=0
Sep 16 14:18:35.111554 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:35.111153    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq" event={"ID":"d8153498-42a5-4138-9ff7-4c9a95e0749b","Type":"ContainerDied","Data":"82c72a1de055e91a321dec6f7de67a06b7c06816e36578c57d762a3f4ffc4a0c"}
Sep 16 14:18:42.142636 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:42.142598    2582 generic.go:356] "Generic (PLEG): container finished" podID="d8153498-42a5-4138-9ff7-4c9a95e0749b" containerID="5c6346515c41ff254cb01a933718796a3b3f0bceaf6ea444a4208aa6026cde2f" exitCode=0
Sep 16 14:18:42.143014 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:42.142662    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq" event={"ID":"d8153498-42a5-4138-9ff7-4c9a95e0749b","Type":"ContainerDied","Data":"5c6346515c41ff254cb01a933718796a3b3f0bceaf6ea444a4208aa6026cde2f"}
Sep 16 14:18:43.262184 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:43.262162    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:43.373706 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:43.373675    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmrkg\" (UniqueName: \"kubernetes.io/projected/d8153498-42a5-4138-9ff7-4c9a95e0749b-kube-api-access-gmrkg\") pod \"d8153498-42a5-4138-9ff7-4c9a95e0749b\" (UID: \"d8153498-42a5-4138-9ff7-4c9a95e0749b\") "
Sep 16 14:18:43.373862 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:43.373727    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8153498-42a5-4138-9ff7-4c9a95e0749b-bundle\") pod \"d8153498-42a5-4138-9ff7-4c9a95e0749b\" (UID: \"d8153498-42a5-4138-9ff7-4c9a95e0749b\") "
Sep 16 14:18:43.373862 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:43.373745    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8153498-42a5-4138-9ff7-4c9a95e0749b-util\") pod \"d8153498-42a5-4138-9ff7-4c9a95e0749b\" (UID: \"d8153498-42a5-4138-9ff7-4c9a95e0749b\") "
Sep 16 14:18:43.374388 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:43.374364    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8153498-42a5-4138-9ff7-4c9a95e0749b-bundle" (OuterVolumeSpecName: "bundle") pod "d8153498-42a5-4138-9ff7-4c9a95e0749b" (UID: "d8153498-42a5-4138-9ff7-4c9a95e0749b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:18:43.375948 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:43.375919    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8153498-42a5-4138-9ff7-4c9a95e0749b-kube-api-access-gmrkg" (OuterVolumeSpecName: "kube-api-access-gmrkg") pod "d8153498-42a5-4138-9ff7-4c9a95e0749b" (UID: "d8153498-42a5-4138-9ff7-4c9a95e0749b"). InnerVolumeSpecName "kube-api-access-gmrkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:18:43.378086 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:43.378068    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8153498-42a5-4138-9ff7-4c9a95e0749b-util" (OuterVolumeSpecName: "util") pod "d8153498-42a5-4138-9ff7-4c9a95e0749b" (UID: "d8153498-42a5-4138-9ff7-4c9a95e0749b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:18:43.474747 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:43.474692    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8153498-42a5-4138-9ff7-4c9a95e0749b-bundle\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:18:43.474747 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:43.474712    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8153498-42a5-4138-9ff7-4c9a95e0749b-util\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:18:43.474747 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:43.474721    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmrkg\" (UniqueName: \"kubernetes.io/projected/d8153498-42a5-4138-9ff7-4c9a95e0749b-kube-api-access-gmrkg\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:18:44.151056 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:44.151032    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq"
Sep 16 14:18:44.151222 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:44.151021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405rkwq" event={"ID":"d8153498-42a5-4138-9ff7-4c9a95e0749b","Type":"ContainerDied","Data":"0d866ef19cd7a812d8775d8b551038c7c4d03bb7cbd19575818adf86cfc65ca5"}
Sep 16 14:18:44.151222 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:44.151151    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d866ef19cd7a812d8775d8b551038c7c4d03bb7cbd19575818adf86cfc65ca5"
Sep 16 14:18:45.140024 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:45.139972    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:18:46.122854 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:46.122819    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:18:47.181401 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.181375    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd"]
Sep 16 14:18:47.181739 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.181592    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8153498-42a5-4138-9ff7-4c9a95e0749b" containerName="util"
Sep 16 14:18:47.181739 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.181603    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8153498-42a5-4138-9ff7-4c9a95e0749b" containerName="util"
Sep 16 14:18:47.181739 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.181610    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8153498-42a5-4138-9ff7-4c9a95e0749b" containerName="pull"
Sep 16 14:18:47.181739 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.181615    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8153498-42a5-4138-9ff7-4c9a95e0749b" containerName="pull"
Sep 16 14:18:47.181739 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.181632    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8153498-42a5-4138-9ff7-4c9a95e0749b" containerName="extract"
Sep 16 14:18:47.181739 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.181637    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8153498-42a5-4138-9ff7-4c9a95e0749b" containerName="extract"
Sep 16 14:18:47.181739 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.181676    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8153498-42a5-4138-9ff7-4c9a95e0749b" containerName="extract"
Sep 16 14:18:47.213944 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.213916    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd"]
Sep 16 14:18:47.214082 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.213997    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd"
Sep 16 14:18:47.220920 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.220874    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 16 14:18:47.220920 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.220876    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:18:47.221085 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.220915    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lxv8s\""
Sep 16 14:18:47.300909 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.300868    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad1b4f92-4f00-434f-820c-122ba2673c2a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6zzfd\" (UID: \"ad1b4f92-4f00-434f-820c-122ba2673c2a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd"
Sep 16 14:18:47.301027 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.300916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wvlm\" (UniqueName: \"kubernetes.io/projected/ad1b4f92-4f00-434f-820c-122ba2673c2a-kube-api-access-8wvlm\") pod \"cert-manager-operator-controller-manager-55c444bf86-6zzfd\" (UID: \"ad1b4f92-4f00-434f-820c-122ba2673c2a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd"
Sep 16 14:18:47.402093 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.402063    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvlm\" (UniqueName: \"kubernetes.io/projected/ad1b4f92-4f00-434f-820c-122ba2673c2a-kube-api-access-8wvlm\") pod \"cert-manager-operator-controller-manager-55c444bf86-6zzfd\" (UID: \"ad1b4f92-4f00-434f-820c-122ba2673c2a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd"
Sep 16 14:18:47.402215 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.402140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad1b4f92-4f00-434f-820c-122ba2673c2a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6zzfd\" (UID: \"ad1b4f92-4f00-434f-820c-122ba2673c2a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd"
Sep 16 14:18:47.402550 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.402530    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad1b4f92-4f00-434f-820c-122ba2673c2a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6zzfd\" (UID: \"ad1b4f92-4f00-434f-820c-122ba2673c2a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd"
Sep 16 14:18:47.413882 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.413863    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wvlm\" (UniqueName: \"kubernetes.io/projected/ad1b4f92-4f00-434f-820c-122ba2673c2a-kube-api-access-8wvlm\") pod \"cert-manager-operator-controller-manager-55c444bf86-6zzfd\" (UID: \"ad1b4f92-4f00-434f-820c-122ba2673c2a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd"
Sep 16 14:18:47.522295 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.522226    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd"
Sep 16 14:18:47.811448 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:47.811338    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd"]
Sep 16 14:18:47.814447 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:18:47.814422    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1b4f92_4f00_434f_820c_122ba2673c2a.slice/crio-6a5212980ed40da284ffddf3351a15998eddb3119d5907549ebe5fc192d66830 WatchSource:0}: Error finding container 6a5212980ed40da284ffddf3351a15998eddb3119d5907549ebe5fc192d66830: Status 404 returned error can't find the container with id 6a5212980ed40da284ffddf3351a15998eddb3119d5907549ebe5fc192d66830
Sep 16 14:18:48.165928 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:48.165866    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd" event={"ID":"ad1b4f92-4f00-434f-820c-122ba2673c2a","Type":"ContainerStarted","Data":"6a5212980ed40da284ffddf3351a15998eddb3119d5907549ebe5fc192d66830"}
Sep 16 14:18:48.785321 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:48.785288    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:18:48.886076 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:48.886047    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:18:53.345154 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:53.345120    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:18:53.415130 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:18:53.415103    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:00.210306 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:00.210269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd" event={"ID":"ad1b4f92-4f00-434f-820c-122ba2673c2a","Type":"ContainerStarted","Data":"9cddda50bd77b153ed16afea33af97d41ceba555933694495d9242317f130122"}
Sep 16 14:19:00.232352 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:00.232280    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6zzfd" podStartSLOduration=1.434507996 podStartE2EDuration="13.232262324s" totalImagesPullingTime="11.797754328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:18:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:19:00.229940771 +0000 UTC m=+259.523629250" watchObservedRunningTime="2026-09-16 14:19:00.232262324 +0000 UTC m=+259.525950804"
Sep 16 14:19:00.490390 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:00.490308    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:00.602658 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:00.602607    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:00.731203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:00.731168    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:01.657609 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.657572    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2xdbg"]
Sep 16 14:19:01.659634 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.659619    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg"
Sep 16 14:19:01.666340 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.666322    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 16 14:19:01.667175 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.667158    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 16 14:19:01.667269 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.667181    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-z67v5\""
Sep 16 14:19:01.688343 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.688320    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2xdbg"]
Sep 16 14:19:01.700433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.700411    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/485df9ec-6bbb-43d9-8626-1bf1feee8d7e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2xdbg\" (UID: \"485df9ec-6bbb-43d9-8626-1bf1feee8d7e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg"
Sep 16 14:19:01.700532 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.700460    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rdrg\" (UniqueName: \"kubernetes.io/projected/485df9ec-6bbb-43d9-8626-1bf1feee8d7e-kube-api-access-2rdrg\") pod \"cert-manager-webhook-6486ffd997-2xdbg\" (UID: \"485df9ec-6bbb-43d9-8626-1bf1feee8d7e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg"
Sep 16 14:19:01.800932 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.800900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rdrg\" (UniqueName: \"kubernetes.io/projected/485df9ec-6bbb-43d9-8626-1bf1feee8d7e-kube-api-access-2rdrg\") pod \"cert-manager-webhook-6486ffd997-2xdbg\" (UID: \"485df9ec-6bbb-43d9-8626-1bf1feee8d7e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg"
Sep 16 14:19:01.801079 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.800951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/485df9ec-6bbb-43d9-8626-1bf1feee8d7e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2xdbg\" (UID: \"485df9ec-6bbb-43d9-8626-1bf1feee8d7e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg"
Sep 16 14:19:01.810928 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.810893    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rdrg\" (UniqueName: \"kubernetes.io/projected/485df9ec-6bbb-43d9-8626-1bf1feee8d7e-kube-api-access-2rdrg\") pod \"cert-manager-webhook-6486ffd997-2xdbg\" (UID: \"485df9ec-6bbb-43d9-8626-1bf1feee8d7e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg"
Sep 16 14:19:01.811061 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.810967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/485df9ec-6bbb-43d9-8626-1bf1feee8d7e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2xdbg\" (UID: \"485df9ec-6bbb-43d9-8626-1bf1feee8d7e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg"
Sep 16 14:19:01.968396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.968298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg"
Sep 16 14:19:01.976951 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.976923    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"]
Sep 16 14:19:01.979738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.979719    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:01.982667 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.982625    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 14:19:01.983049 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.982717    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gdfsj\""
Sep 16 14:19:01.983171 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.982761    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 14:19:01.991386 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:01.991354    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"]
Sep 16 14:19:02.001971 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.001945    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bb589e3-2b22-47a8-9472-edea136e0143-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd\" (UID: \"8bb589e3-2b22-47a8-9472-edea136e0143\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:02.002075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.002003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bb589e3-2b22-47a8-9472-edea136e0143-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd\" (UID: \"8bb589e3-2b22-47a8-9472-edea136e0143\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:02.002075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.002028    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrk62\" (UniqueName: \"kubernetes.io/projected/8bb589e3-2b22-47a8-9472-edea136e0143-kube-api-access-jrk62\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd\" (UID: \"8bb589e3-2b22-47a8-9472-edea136e0143\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:02.102721 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.102688    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bb589e3-2b22-47a8-9472-edea136e0143-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd\" (UID: \"8bb589e3-2b22-47a8-9472-edea136e0143\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:02.102897 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.102737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bb589e3-2b22-47a8-9472-edea136e0143-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd\" (UID: \"8bb589e3-2b22-47a8-9472-edea136e0143\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:02.102970 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.102907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrk62\" (UniqueName: \"kubernetes.io/projected/8bb589e3-2b22-47a8-9472-edea136e0143-kube-api-access-jrk62\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd\" (UID: \"8bb589e3-2b22-47a8-9472-edea136e0143\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:02.103064 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.103043    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bb589e3-2b22-47a8-9472-edea136e0143-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd\" (UID: \"8bb589e3-2b22-47a8-9472-edea136e0143\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:02.103136 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.103115    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bb589e3-2b22-47a8-9472-edea136e0143-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd\" (UID: \"8bb589e3-2b22-47a8-9472-edea136e0143\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:02.112127 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.112095    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrk62\" (UniqueName: \"kubernetes.io/projected/8bb589e3-2b22-47a8-9472-edea136e0143-kube-api-access-jrk62\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd\" (UID: \"8bb589e3-2b22-47a8-9472-edea136e0143\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:02.244333 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.244262    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2xdbg"]
Sep 16 14:19:02.247537 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:19:02.247514    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod485df9ec_6bbb_43d9_8626_1bf1feee8d7e.slice/crio-81f33792175e5307971e9f0754c550b086c47d9650e42c13974c40b836ba89f1 WatchSource:0}: Error finding container 81f33792175e5307971e9f0754c550b086c47d9650e42c13974c40b836ba89f1: Status 404 returned error can't find the container with id 81f33792175e5307971e9f0754c550b086c47d9650e42c13974c40b836ba89f1
Sep 16 14:19:02.301157 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.301134    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:02.570881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.570854    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"]
Sep 16 14:19:02.573138 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:19:02.573108    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb589e3_2b22_47a8_9472_edea136e0143.slice/crio-d82ff1038c9dccec7a638095c21bdce49a9d98c19172116dc12bc1675fd6aa78 WatchSource:0}: Error finding container d82ff1038c9dccec7a638095c21bdce49a9d98c19172116dc12bc1675fd6aa78: Status 404 returned error can't find the container with id d82ff1038c9dccec7a638095c21bdce49a9d98c19172116dc12bc1675fd6aa78
Sep 16 14:19:02.949624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:02.949542    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:03.121105 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:03.121073    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:03.221319 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:03.221222    2582 generic.go:356] "Generic (PLEG): container finished" podID="8bb589e3-2b22-47a8-9472-edea136e0143" containerID="9018368fdea9a73ff29384f9825cb6476132811f924d0a17358b22487dc55404" exitCode=0
Sep 16 14:19:03.221458 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:03.221310    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd" event={"ID":"8bb589e3-2b22-47a8-9472-edea136e0143","Type":"ContainerDied","Data":"9018368fdea9a73ff29384f9825cb6476132811f924d0a17358b22487dc55404"}
Sep 16 14:19:03.221458 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:03.221369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd" event={"ID":"8bb589e3-2b22-47a8-9472-edea136e0143","Type":"ContainerStarted","Data":"d82ff1038c9dccec7a638095c21bdce49a9d98c19172116dc12bc1675fd6aa78"}
Sep 16 14:19:03.222609 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:03.222580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg" event={"ID":"485df9ec-6bbb-43d9-8626-1bf1feee8d7e","Type":"ContainerStarted","Data":"81f33792175e5307971e9f0754c550b086c47d9650e42c13974c40b836ba89f1"}
Sep 16 14:19:07.242254 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:07.242203    2582 generic.go:356] "Generic (PLEG): container finished" podID="8bb589e3-2b22-47a8-9472-edea136e0143" containerID="07d20867700571ecd70505747696483aceabf21deffd5d2fbec632ab8603fb5b" exitCode=0
Sep 16 14:19:07.242650 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:07.242287    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd" event={"ID":"8bb589e3-2b22-47a8-9472-edea136e0143","Type":"ContainerDied","Data":"07d20867700571ecd70505747696483aceabf21deffd5d2fbec632ab8603fb5b"}
Sep 16 14:19:07.243945 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:07.243920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg" event={"ID":"485df9ec-6bbb-43d9-8626-1bf1feee8d7e","Type":"ContainerStarted","Data":"99b00d75348301ce9aa7207d456c7e7e5aa42b370ecd43af9f089fa5c3a686fc"}
Sep 16 14:19:07.244072 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:07.243990    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg"
Sep 16 14:19:07.281567 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:07.281517    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg" podStartSLOduration=2.012184063 podStartE2EDuration="6.281499194s" totalImagesPullingTime="4.269315131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:19:07.280379435 +0000 UTC m=+266.574067914" watchObservedRunningTime="2026-09-16 14:19:07.281499194 +0000 UTC m=+266.575187673"
Sep 16 14:19:08.250138 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:08.250102    2582 generic.go:356] "Generic (PLEG): container finished" podID="8bb589e3-2b22-47a8-9472-edea136e0143" containerID="4d4573b908957867734687f5d1d749acb562a3bd28bb43103443ccc8f6b60f5b" exitCode=0
Sep 16 14:19:08.250547 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:08.250177    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd" event={"ID":"8bb589e3-2b22-47a8-9472-edea136e0143","Type":"ContainerDied","Data":"4d4573b908957867734687f5d1d749acb562a3bd28bb43103443ccc8f6b60f5b"}
Sep 16 14:19:09.371373 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:09.371350    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:09.452764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:09.452733    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrk62\" (UniqueName: \"kubernetes.io/projected/8bb589e3-2b22-47a8-9472-edea136e0143-kube-api-access-jrk62\") pod \"8bb589e3-2b22-47a8-9472-edea136e0143\" (UID: \"8bb589e3-2b22-47a8-9472-edea136e0143\") "
Sep 16 14:19:09.452931 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:09.452788    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bb589e3-2b22-47a8-9472-edea136e0143-util\") pod \"8bb589e3-2b22-47a8-9472-edea136e0143\" (UID: \"8bb589e3-2b22-47a8-9472-edea136e0143\") "
Sep 16 14:19:09.452931 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:09.452822    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bb589e3-2b22-47a8-9472-edea136e0143-bundle\") pod \"8bb589e3-2b22-47a8-9472-edea136e0143\" (UID: \"8bb589e3-2b22-47a8-9472-edea136e0143\") "
Sep 16 14:19:09.453285 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:09.453259    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bb589e3-2b22-47a8-9472-edea136e0143-bundle" (OuterVolumeSpecName: "bundle") pod "8bb589e3-2b22-47a8-9472-edea136e0143" (UID: "8bb589e3-2b22-47a8-9472-edea136e0143"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:19:09.454810 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:09.454786    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bb589e3-2b22-47a8-9472-edea136e0143-kube-api-access-jrk62" (OuterVolumeSpecName: "kube-api-access-jrk62") pod "8bb589e3-2b22-47a8-9472-edea136e0143" (UID: "8bb589e3-2b22-47a8-9472-edea136e0143"). InnerVolumeSpecName "kube-api-access-jrk62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:19:09.457304 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:09.457280    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bb589e3-2b22-47a8-9472-edea136e0143-util" (OuterVolumeSpecName: "util") pod "8bb589e3-2b22-47a8-9472-edea136e0143" (UID: "8bb589e3-2b22-47a8-9472-edea136e0143"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:19:09.553374 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:09.553350    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrk62\" (UniqueName: \"kubernetes.io/projected/8bb589e3-2b22-47a8-9472-edea136e0143-kube-api-access-jrk62\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:19:09.553374 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:09.553374    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bb589e3-2b22-47a8-9472-edea136e0143-util\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:19:09.553535 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:09.553384    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bb589e3-2b22-47a8-9472-edea136e0143-bundle\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:19:10.259776 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:10.259743    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd" event={"ID":"8bb589e3-2b22-47a8-9472-edea136e0143","Type":"ContainerDied","Data":"d82ff1038c9dccec7a638095c21bdce49a9d98c19172116dc12bc1675fd6aa78"}
Sep 16 14:19:10.259932 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:10.259781    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnrnrd"
Sep 16 14:19:10.259932 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:10.259791    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d82ff1038c9dccec7a638095c21bdce49a9d98c19172116dc12bc1675fd6aa78"
Sep 16 14:19:10.703382 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:10.703350    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:13.236091 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:13.236060    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:13.252588 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:13.252565    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2xdbg"
Sep 16 14:19:13.336916 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:13.336886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:13.462874 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:13.462843    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:13.912283 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:13.912252    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:18.971362 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:18.971331    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:19.071574 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:19.071540    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:20.802007 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.801974    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"]
Sep 16 14:19:20.802385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.802210    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bb589e3-2b22-47a8-9472-edea136e0143" containerName="extract"
Sep 16 14:19:20.802385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.802219    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bb589e3-2b22-47a8-9472-edea136e0143" containerName="extract"
Sep 16 14:19:20.802385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.802228    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bb589e3-2b22-47a8-9472-edea136e0143" containerName="util"
Sep 16 14:19:20.802385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.802248    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bb589e3-2b22-47a8-9472-edea136e0143" containerName="util"
Sep 16 14:19:20.802385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.802258    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bb589e3-2b22-47a8-9472-edea136e0143" containerName="pull"
Sep 16 14:19:20.802385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.802265    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bb589e3-2b22-47a8-9472-edea136e0143" containerName="pull"
Sep 16 14:19:20.802385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.802317    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bb589e3-2b22-47a8-9472-edea136e0143" containerName="extract"
Sep 16 14:19:20.805142 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.805125    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:20.808152 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.808132    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 14:19:20.809158 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.809132    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 14:19:20.809158 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.809133    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gdfsj\""
Sep 16 14:19:20.814935 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.814914    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"]
Sep 16 14:19:20.835629 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.835603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b62f8d58-0a01-41f3-ac63-6ae81ab40683-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt\" (UID: \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:20.835736 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.835637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b62f8d58-0a01-41f3-ac63-6ae81ab40683-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt\" (UID: \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:20.835736 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.835705    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6r7z\" (UniqueName: \"kubernetes.io/projected/b62f8d58-0a01-41f3-ac63-6ae81ab40683-kube-api-access-z6r7z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt\" (UID: \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:20.936294 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.936257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6r7z\" (UniqueName: \"kubernetes.io/projected/b62f8d58-0a01-41f3-ac63-6ae81ab40683-kube-api-access-z6r7z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt\" (UID: \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:20.936294 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.936299    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b62f8d58-0a01-41f3-ac63-6ae81ab40683-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt\" (UID: \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:20.936501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.936424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b62f8d58-0a01-41f3-ac63-6ae81ab40683-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt\" (UID: \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:20.936692 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.936673    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b62f8d58-0a01-41f3-ac63-6ae81ab40683-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt\" (UID: \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:20.936774 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.936755    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b62f8d58-0a01-41f3-ac63-6ae81ab40683-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt\" (UID: \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:20.938225 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.938196    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:20.944547 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:20.944524    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6r7z\" (UniqueName: \"kubernetes.io/projected/b62f8d58-0a01-41f3-ac63-6ae81ab40683-kube-api-access-z6r7z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt\" (UID: \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:21.113815 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:21.113738    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:21.385881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:21.385851    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"]
Sep 16 14:19:21.388089 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:19:21.388063    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb62f8d58_0a01_41f3_ac63_6ae81ab40683.slice/crio-1bf9cb70c290b0c7f99a095e4f7f98cbdfbf7f4d259819d696d81c58b58ac69c WatchSource:0}: Error finding container 1bf9cb70c290b0c7f99a095e4f7f98cbdfbf7f4d259819d696d81c58b58ac69c: Status 404 returned error can't find the container with id 1bf9cb70c290b0c7f99a095e4f7f98cbdfbf7f4d259819d696d81c58b58ac69c
Sep 16 14:19:22.308581 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:22.308543    2582 generic.go:356] "Generic (PLEG): container finished" podID="b62f8d58-0a01-41f3-ac63-6ae81ab40683" containerID="548350fdb555fa0540b97c2a10db13a1ca352b8b701cdb42f0f0c783e8def5b0" exitCode=0
Sep 16 14:19:22.308940 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:22.308625    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt" event={"ID":"b62f8d58-0a01-41f3-ac63-6ae81ab40683","Type":"ContainerDied","Data":"548350fdb555fa0540b97c2a10db13a1ca352b8b701cdb42f0f0c783e8def5b0"}
Sep 16 14:19:22.308940 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:22.308670    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt" event={"ID":"b62f8d58-0a01-41f3-ac63-6ae81ab40683","Type":"ContainerStarted","Data":"1bf9cb70c290b0c7f99a095e4f7f98cbdfbf7f4d259819d696d81c58b58ac69c"}
Sep 16 14:19:23.314521 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:23.314492    2582 generic.go:356] "Generic (PLEG): container finished" podID="b62f8d58-0a01-41f3-ac63-6ae81ab40683" containerID="dac38c76bf0899a7969c795aea71289aa2eb1a4ef040d6dd23d21dc0cfbda467" exitCode=0
Sep 16 14:19:23.314808 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:23.314546    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt" event={"ID":"b62f8d58-0a01-41f3-ac63-6ae81ab40683","Type":"ContainerDied","Data":"dac38c76bf0899a7969c795aea71289aa2eb1a4ef040d6dd23d21dc0cfbda467"}
Sep 16 14:19:24.321030 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:24.320995    2582 generic.go:356] "Generic (PLEG): container finished" podID="b62f8d58-0a01-41f3-ac63-6ae81ab40683" containerID="a71e81be695e1e71dab2fe35cff1f31bc842140ad3d512ceae5a8de07ab829d8" exitCode=0
Sep 16 14:19:24.321412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:24.321077    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt" event={"ID":"b62f8d58-0a01-41f3-ac63-6ae81ab40683","Type":"ContainerDied","Data":"a71e81be695e1e71dab2fe35cff1f31bc842140ad3d512ceae5a8de07ab829d8"}
Sep 16 14:19:25.452045 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:25.452022    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:25.567254 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:25.567212    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b62f8d58-0a01-41f3-ac63-6ae81ab40683-bundle\") pod \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\" (UID: \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\") "
Sep 16 14:19:25.567421 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:25.567277    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b62f8d58-0a01-41f3-ac63-6ae81ab40683-util\") pod \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\" (UID: \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\") "
Sep 16 14:19:25.567421 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:25.567305    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6r7z\" (UniqueName: \"kubernetes.io/projected/b62f8d58-0a01-41f3-ac63-6ae81ab40683-kube-api-access-z6r7z\") pod \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\" (UID: \"b62f8d58-0a01-41f3-ac63-6ae81ab40683\") "
Sep 16 14:19:25.567890 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:25.567864    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b62f8d58-0a01-41f3-ac63-6ae81ab40683-bundle" (OuterVolumeSpecName: "bundle") pod "b62f8d58-0a01-41f3-ac63-6ae81ab40683" (UID: "b62f8d58-0a01-41f3-ac63-6ae81ab40683"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:19:25.569415 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:25.569390    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b62f8d58-0a01-41f3-ac63-6ae81ab40683-kube-api-access-z6r7z" (OuterVolumeSpecName: "kube-api-access-z6r7z") pod "b62f8d58-0a01-41f3-ac63-6ae81ab40683" (UID: "b62f8d58-0a01-41f3-ac63-6ae81ab40683"). InnerVolumeSpecName "kube-api-access-z6r7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:19:25.575472 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:25.575429    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b62f8d58-0a01-41f3-ac63-6ae81ab40683-util" (OuterVolumeSpecName: "util") pod "b62f8d58-0a01-41f3-ac63-6ae81ab40683" (UID: "b62f8d58-0a01-41f3-ac63-6ae81ab40683"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:19:25.668468 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:25.668372    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6r7z\" (UniqueName: \"kubernetes.io/projected/b62f8d58-0a01-41f3-ac63-6ae81ab40683-kube-api-access-z6r7z\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:19:25.668468 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:25.668413    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b62f8d58-0a01-41f3-ac63-6ae81ab40683-bundle\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:19:25.668468 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:25.668423    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b62f8d58-0a01-41f3-ac63-6ae81ab40683-util\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:19:26.332916 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:26.332882    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt" event={"ID":"b62f8d58-0a01-41f3-ac63-6ae81ab40683","Type":"ContainerDied","Data":"1bf9cb70c290b0c7f99a095e4f7f98cbdfbf7f4d259819d696d81c58b58ac69c"}
Sep 16 14:19:26.332916 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:26.332911    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn55nt"
Sep 16 14:19:26.333113 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:26.332935    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bf9cb70c290b0c7f99a095e4f7f98cbdfbf7f4d259819d696d81c58b58ac69c"
Sep 16 14:19:37.436892 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.436856    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:37.800350 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.800319    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"]
Sep 16 14:19:37.800581 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.800568    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b62f8d58-0a01-41f3-ac63-6ae81ab40683" containerName="pull"
Sep 16 14:19:37.800624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.800583    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b62f8d58-0a01-41f3-ac63-6ae81ab40683" containerName="pull"
Sep 16 14:19:37.800624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.800592    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b62f8d58-0a01-41f3-ac63-6ae81ab40683" containerName="util"
Sep 16 14:19:37.800624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.800597    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b62f8d58-0a01-41f3-ac63-6ae81ab40683" containerName="util"
Sep 16 14:19:37.800624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.800606    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b62f8d58-0a01-41f3-ac63-6ae81ab40683" containerName="extract"
Sep 16 14:19:37.800624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.800611    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b62f8d58-0a01-41f3-ac63-6ae81ab40683" containerName="extract"
Sep 16 14:19:37.800770 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.800657    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b62f8d58-0a01-41f3-ac63-6ae81ab40683" containerName="extract"
Sep 16 14:19:37.802467 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.802451    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:37.805165 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.805142    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gdfsj\""
Sep 16 14:19:37.805300 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.805266    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 14:19:37.805408 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.805312    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 14:19:37.813124 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.813102    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"]
Sep 16 14:19:37.855514 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.855491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4016f4e6-f382-4c83-87ed-db23eb826f20-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf\" (UID: \"4016f4e6-f382-4c83-87ed-db23eb826f20\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:37.855621 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.855526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4016f4e6-f382-4c83-87ed-db23eb826f20-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf\" (UID: \"4016f4e6-f382-4c83-87ed-db23eb826f20\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:37.855621 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.855553    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd2xt\" (UniqueName: \"kubernetes.io/projected/4016f4e6-f382-4c83-87ed-db23eb826f20-kube-api-access-wd2xt\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf\" (UID: \"4016f4e6-f382-4c83-87ed-db23eb826f20\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:37.956162 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.956136    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4016f4e6-f382-4c83-87ed-db23eb826f20-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf\" (UID: \"4016f4e6-f382-4c83-87ed-db23eb826f20\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:37.956282 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.956175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4016f4e6-f382-4c83-87ed-db23eb826f20-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf\" (UID: \"4016f4e6-f382-4c83-87ed-db23eb826f20\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:37.956282 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.956205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd2xt\" (UniqueName: \"kubernetes.io/projected/4016f4e6-f382-4c83-87ed-db23eb826f20-kube-api-access-wd2xt\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf\" (UID: \"4016f4e6-f382-4c83-87ed-db23eb826f20\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:37.956501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.956483    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4016f4e6-f382-4c83-87ed-db23eb826f20-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf\" (UID: \"4016f4e6-f382-4c83-87ed-db23eb826f20\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:37.956561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.956517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4016f4e6-f382-4c83-87ed-db23eb826f20-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf\" (UID: \"4016f4e6-f382-4c83-87ed-db23eb826f20\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:37.964297 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:37.964277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd2xt\" (UniqueName: \"kubernetes.io/projected/4016f4e6-f382-4c83-87ed-db23eb826f20-kube-api-access-wd2xt\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf\" (UID: \"4016f4e6-f382-4c83-87ed-db23eb826f20\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:38.009381 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.009353    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"]
Sep 16 14:19:38.011333 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.011319    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.014580 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.014562    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 14:19:38.014674 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.014648    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k7vhv\""
Sep 16 14:19:38.014942 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.014926    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 14:19:38.015083 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.015055    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 14:19:38.015289 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.015275    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 14:19:38.029918 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.029895    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"]
Sep 16 14:19:38.056634 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.056577    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65910c5e-0c61-4fb2-8be1-4098344330e0-tmp\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.056634 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.056613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65910c5e-0c61-4fb2-8be1-4098344330e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.056755 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.056656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65910c5e-0c61-4fb2-8be1-4098344330e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.056755 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.056725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/65910c5e-0c61-4fb2-8be1-4098344330e0-manifests\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.056824 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.056757    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcrjw\" (UniqueName: \"kubernetes.io/projected/65910c5e-0c61-4fb2-8be1-4098344330e0-kube-api-access-fcrjw\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.111310 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.111289    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:38.157542 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.157514    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65910c5e-0c61-4fb2-8be1-4098344330e0-tmp\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.157676 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.157552    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65910c5e-0c61-4fb2-8be1-4098344330e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.157676 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.157585    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65910c5e-0c61-4fb2-8be1-4098344330e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.157676 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.157632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/65910c5e-0c61-4fb2-8be1-4098344330e0-manifests\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.157676 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.157662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcrjw\" (UniqueName: \"kubernetes.io/projected/65910c5e-0c61-4fb2-8be1-4098344330e0-kube-api-access-fcrjw\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.159470 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.158417    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/65910c5e-0c61-4fb2-8be1-4098344330e0-manifests\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.160770 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.160747    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65910c5e-0c61-4fb2-8be1-4098344330e0-tmp\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.160899 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.160805    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65910c5e-0c61-4fb2-8be1-4098344330e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.161080 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.161042    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65910c5e-0c61-4fb2-8be1-4098344330e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.180750 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.180720    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcrjw\" (UniqueName: \"kubernetes.io/projected/65910c5e-0c61-4fb2-8be1-4098344330e0-kube-api-access-fcrjw\") pod \"opendatahub-operator-controller-manager-68b85944db-wpx5d\" (UID: \"65910c5e-0c61-4fb2-8be1-4098344330e0\") " pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.320819 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.320746    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:38.379659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.379585    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"]
Sep 16 14:19:38.382115 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:19:38.382090    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4016f4e6_f382_4c83_87ed_db23eb826f20.slice/crio-c7f34aa9fdffd60fc76fc2b48b5b9ad80e900d57fdfdfa66a673af021247f4d1 WatchSource:0}: Error finding container c7f34aa9fdffd60fc76fc2b48b5b9ad80e900d57fdfdfa66a673af021247f4d1: Status 404 returned error can't find the container with id c7f34aa9fdffd60fc76fc2b48b5b9ad80e900d57fdfdfa66a673af021247f4d1
Sep 16 14:19:38.597014 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:38.596940    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"]
Sep 16 14:19:38.601039 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:19:38.601012    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65910c5e_0c61_4fb2_8be1_4098344330e0.slice/crio-f58ae9689319f462320473516ef262a146d15c9001b179ed0bdb773ef40dc77b WatchSource:0}: Error finding container f58ae9689319f462320473516ef262a146d15c9001b179ed0bdb773ef40dc77b: Status 404 returned error can't find the container with id f58ae9689319f462320473516ef262a146d15c9001b179ed0bdb773ef40dc77b
Sep 16 14:19:39.388526 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:39.388489    2582 generic.go:356] "Generic (PLEG): container finished" podID="4016f4e6-f382-4c83-87ed-db23eb826f20" containerID="5263d19da490a08a4ff518301e0417419389bffe00f3a5cfc009bc5c508f36ee" exitCode=0
Sep 16 14:19:39.388706 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:39.388584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf" event={"ID":"4016f4e6-f382-4c83-87ed-db23eb826f20","Type":"ContainerDied","Data":"5263d19da490a08a4ff518301e0417419389bffe00f3a5cfc009bc5c508f36ee"}
Sep 16 14:19:39.388706 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:39.388629    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf" event={"ID":"4016f4e6-f382-4c83-87ed-db23eb826f20","Type":"ContainerStarted","Data":"c7f34aa9fdffd60fc76fc2b48b5b9ad80e900d57fdfdfa66a673af021247f4d1"}
Sep 16 14:19:39.390782 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:39.390753    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d" event={"ID":"65910c5e-0c61-4fb2-8be1-4098344330e0","Type":"ContainerStarted","Data":"f58ae9689319f462320473516ef262a146d15c9001b179ed0bdb773ef40dc77b"}
Sep 16 14:19:39.957914 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:39.957870    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:41.577980 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:41.577962    2582 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 14:19:42.406561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:42.406515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d" event={"ID":"65910c5e-0c61-4fb2-8be1-4098344330e0","Type":"ContainerStarted","Data":"ca752618dbb68ff42f483c702428d0a4665adfdc7f1df27567293ea49d542311"}
Sep 16 14:19:42.408224 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:42.408196    2582 generic.go:356] "Generic (PLEG): container finished" podID="4016f4e6-f382-4c83-87ed-db23eb826f20" containerID="510cf65fe1f0d99f5db22f57c5577462bb773e1cf9d809de4ce26410c52675dc" exitCode=0
Sep 16 14:19:42.408224 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:42.408229    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf" event={"ID":"4016f4e6-f382-4c83-87ed-db23eb826f20","Type":"ContainerDied","Data":"510cf65fe1f0d99f5db22f57c5577462bb773e1cf9d809de4ce26410c52675dc"}
Sep 16 14:19:43.074426 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:43.074393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:43.182848 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:43.182819    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:43.414379 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:43.414283    2582 generic.go:356] "Generic (PLEG): container finished" podID="4016f4e6-f382-4c83-87ed-db23eb826f20" containerID="c545a46192cfaf278b93fe7a7c722d3109700d396d38494bc97f28a90a634c9b" exitCode=0
Sep 16 14:19:43.414379 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:43.414357    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf" event={"ID":"4016f4e6-f382-4c83-87ed-db23eb826f20","Type":"ContainerDied","Data":"c545a46192cfaf278b93fe7a7c722d3109700d396d38494bc97f28a90a634c9b"}
Sep 16 14:19:43.415968 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:43.415937    2582 generic.go:356] "Generic (PLEG): container finished" podID="65910c5e-0c61-4fb2-8be1-4098344330e0" containerID="ca752618dbb68ff42f483c702428d0a4665adfdc7f1df27567293ea49d542311" exitCode=0
Sep 16 14:19:43.416072 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:43.416016    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d" event={"ID":"65910c5e-0c61-4fb2-8be1-4098344330e0","Type":"ContainerDied","Data":"ca752618dbb68ff42f483c702428d0a4665adfdc7f1df27567293ea49d542311"}
Sep 16 14:19:43.416469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:43.416455    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:19:44.423042 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.423008    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d" event={"ID":"65910c5e-0c61-4fb2-8be1-4098344330e0","Type":"ContainerStarted","Data":"37d25e24dc0632ac8f4f08ac887e2fe6665aff5e1ee7e4aa6e031c0eb89999ac"}
Sep 16 14:19:44.423534 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.423322    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:44.448418 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.448364    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d" podStartSLOduration=3.077542674 podStartE2EDuration="7.448345623s" totalImagesPullingTime="3.309082286s" totalInitContainerRuntime="1.061720663s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:19:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:19:44.447177968 +0000 UTC m=+303.740866459" watchObservedRunningTime="2026-09-16 14:19:44.448345623 +0000 UTC m=+303.742034102"
Sep 16 14:19:44.545310 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.545270    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:44.613806 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.613774    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4016f4e6-f382-4c83-87ed-db23eb826f20-util\") pod \"4016f4e6-f382-4c83-87ed-db23eb826f20\" (UID: \"4016f4e6-f382-4c83-87ed-db23eb826f20\") "
Sep 16 14:19:44.613988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.613814    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4016f4e6-f382-4c83-87ed-db23eb826f20-bundle\") pod \"4016f4e6-f382-4c83-87ed-db23eb826f20\" (UID: \"4016f4e6-f382-4c83-87ed-db23eb826f20\") "
Sep 16 14:19:44.613988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.613836    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd2xt\" (UniqueName: \"kubernetes.io/projected/4016f4e6-f382-4c83-87ed-db23eb826f20-kube-api-access-wd2xt\") pod \"4016f4e6-f382-4c83-87ed-db23eb826f20\" (UID: \"4016f4e6-f382-4c83-87ed-db23eb826f20\") "
Sep 16 14:19:44.614517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.614487    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4016f4e6-f382-4c83-87ed-db23eb826f20-bundle" (OuterVolumeSpecName: "bundle") pod "4016f4e6-f382-4c83-87ed-db23eb826f20" (UID: "4016f4e6-f382-4c83-87ed-db23eb826f20"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:19:44.615967 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.615934    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4016f4e6-f382-4c83-87ed-db23eb826f20-kube-api-access-wd2xt" (OuterVolumeSpecName: "kube-api-access-wd2xt") pod "4016f4e6-f382-4c83-87ed-db23eb826f20" (UID: "4016f4e6-f382-4c83-87ed-db23eb826f20"). InnerVolumeSpecName "kube-api-access-wd2xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:19:44.619393 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.619368    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4016f4e6-f382-4c83-87ed-db23eb826f20-util" (OuterVolumeSpecName: "util") pod "4016f4e6-f382-4c83-87ed-db23eb826f20" (UID: "4016f4e6-f382-4c83-87ed-db23eb826f20"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:19:44.714502 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.714417    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4016f4e6-f382-4c83-87ed-db23eb826f20-util\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:19:44.714502 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.714445    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4016f4e6-f382-4c83-87ed-db23eb826f20-bundle\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:19:44.714502 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:44.714456    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd2xt\" (UniqueName: \"kubernetes.io/projected/4016f4e6-f382-4c83-87ed-db23eb826f20-kube-api-access-wd2xt\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:19:45.429109 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:45.429080    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf"
Sep 16 14:19:45.429501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:45.429081    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06blhf" event={"ID":"4016f4e6-f382-4c83-87ed-db23eb826f20","Type":"ContainerDied","Data":"c7f34aa9fdffd60fc76fc2b48b5b9ad80e900d57fdfdfa66a673af021247f4d1"}
Sep 16 14:19:45.429501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:45.429211    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7f34aa9fdffd60fc76fc2b48b5b9ad80e900d57fdfdfa66a673af021247f4d1"
Sep 16 14:19:49.711742 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:49.711707    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:49.826540 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:49.826511    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:55.431388 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:55.431357    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68b85944db-wpx5d"
Sep 16 14:19:57.975959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:57.975924    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:58.098894 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.098862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:58.410747 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.410715    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:58.602672 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.602639    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:19:58.911188 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.911155    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75f575964-l8ggl"]
Sep 16 14:19:58.911429 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.911417    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4016f4e6-f382-4c83-87ed-db23eb826f20" containerName="pull"
Sep 16 14:19:58.911473 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.911430    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4016f4e6-f382-4c83-87ed-db23eb826f20" containerName="pull"
Sep 16 14:19:58.911473 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.911443    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4016f4e6-f382-4c83-87ed-db23eb826f20" containerName="extract"
Sep 16 14:19:58.911473 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.911449    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4016f4e6-f382-4c83-87ed-db23eb826f20" containerName="extract"
Sep 16 14:19:58.911473 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.911464    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4016f4e6-f382-4c83-87ed-db23eb826f20" containerName="util"
Sep 16 14:19:58.911473 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.911470    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4016f4e6-f382-4c83-87ed-db23eb826f20" containerName="util"
Sep 16 14:19:58.911620 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.911516    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4016f4e6-f382-4c83-87ed-db23eb826f20" containerName="extract"
Sep 16 14:19:58.920327 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.920300    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl"
Sep 16 14:19:58.925442 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.925415    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 16 14:19:58.925576 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.925462    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 16 14:19:58.925576 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.925562    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 14:19:58.925769 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.925752    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 14:19:58.927167 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.926938    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8cklk\""
Sep 16 14:19:58.935327 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:58.935294    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75f575964-l8ggl"]
Sep 16 14:19:59.008505 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:59.008474    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxsx4\" (UniqueName: \"kubernetes.io/projected/69bcb2fc-ddc8-4307-8c5c-93c38a1ba938-kube-api-access-rxsx4\") pod \"kube-auth-proxy-75f575964-l8ggl\" (UID: \"69bcb2fc-ddc8-4307-8c5c-93c38a1ba938\") " pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl"
Sep 16 14:19:59.008824 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:59.008581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69bcb2fc-ddc8-4307-8c5c-93c38a1ba938-tmp\") pod \"kube-auth-proxy-75f575964-l8ggl\" (UID: \"69bcb2fc-ddc8-4307-8c5c-93c38a1ba938\") " pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl"
Sep 16 14:19:59.008824 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:59.008610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69bcb2fc-ddc8-4307-8c5c-93c38a1ba938-tls-certs\") pod \"kube-auth-proxy-75f575964-l8ggl\" (UID: \"69bcb2fc-ddc8-4307-8c5c-93c38a1ba938\") " pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl"
Sep 16 14:19:59.109535 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:59.109499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69bcb2fc-ddc8-4307-8c5c-93c38a1ba938-tmp\") pod \"kube-auth-proxy-75f575964-l8ggl\" (UID: \"69bcb2fc-ddc8-4307-8c5c-93c38a1ba938\") " pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl"
Sep 16 14:19:59.109535 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:59.109534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69bcb2fc-ddc8-4307-8c5c-93c38a1ba938-tls-certs\") pod \"kube-auth-proxy-75f575964-l8ggl\" (UID: \"69bcb2fc-ddc8-4307-8c5c-93c38a1ba938\") " pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl"
Sep 16 14:19:59.109729 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:59.109559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxsx4\" (UniqueName: \"kubernetes.io/projected/69bcb2fc-ddc8-4307-8c5c-93c38a1ba938-kube-api-access-rxsx4\") pod \"kube-auth-proxy-75f575964-l8ggl\" (UID: \"69bcb2fc-ddc8-4307-8c5c-93c38a1ba938\") " pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl"
Sep 16 14:19:59.111791 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:59.111765    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69bcb2fc-ddc8-4307-8c5c-93c38a1ba938-tmp\") pod \"kube-auth-proxy-75f575964-l8ggl\" (UID: \"69bcb2fc-ddc8-4307-8c5c-93c38a1ba938\") " pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl"
Sep 16 14:19:59.111895 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:59.111844    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69bcb2fc-ddc8-4307-8c5c-93c38a1ba938-tls-certs\") pod \"kube-auth-proxy-75f575964-l8ggl\" (UID: \"69bcb2fc-ddc8-4307-8c5c-93c38a1ba938\") " pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl"
Sep 16 14:19:59.142651 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:59.142625    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxsx4\" (UniqueName: \"kubernetes.io/projected/69bcb2fc-ddc8-4307-8c5c-93c38a1ba938-kube-api-access-rxsx4\") pod \"kube-auth-proxy-75f575964-l8ggl\" (UID: \"69bcb2fc-ddc8-4307-8c5c-93c38a1ba938\") " pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl"
Sep 16 14:19:59.229566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:59.229497    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl"
Sep 16 14:19:59.518527 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:19:59.518448    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75f575964-l8ggl"]
Sep 16 14:19:59.522130 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:19:59.522105    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bcb2fc_ddc8_4307_8c5c_93c38a1ba938.slice/crio-f4a5b0c1b67cae09dc1c3af516f3b6c013a382c1b959c1f3a404c931300b5b71 WatchSource:0}: Error finding container f4a5b0c1b67cae09dc1c3af516f3b6c013a382c1b959c1f3a404c931300b5b71: Status 404 returned error can't find the container with id f4a5b0c1b67cae09dc1c3af516f3b6c013a382c1b959c1f3a404c931300b5b71
Sep 16 14:20:00.491574 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:00.491543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl" event={"ID":"69bcb2fc-ddc8-4307-8c5c-93c38a1ba938","Type":"ContainerStarted","Data":"f4a5b0c1b67cae09dc1c3af516f3b6c013a382c1b959c1f3a404c931300b5b71"}
Sep 16 14:20:00.757665 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:00.757581    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:00.866358 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:00.866327    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:02.342248 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:02.342209    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:03.507744 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:03.507660    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl" event={"ID":"69bcb2fc-ddc8-4307-8c5c-93c38a1ba938","Type":"ContainerStarted","Data":"1460c90190f2b705293de6babef83fd57125a4a1ed439e33f55518daae079e95"}
Sep 16 14:20:03.533342 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:03.533299    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75f575964-l8ggl" podStartSLOduration=1.9720341879999999 podStartE2EDuration="5.533284631s" totalImagesPullingTime="3.561250443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:20:03.532907189 +0000 UTC m=+322.826595668" watchObservedRunningTime="2026-09-16 14:20:03.533284631 +0000 UTC m=+322.826973109"
Sep 16 14:20:05.672002 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:05.671964    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:07.725752 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:07.725722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:07.835025 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:07.834989    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:07.993250 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:07.993163    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:08.093758 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.093725    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:08.248813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.248736    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"]
Sep 16 14:20:08.251693 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.251661    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.254350 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.254326    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 14:20:08.254455 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.254405    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-42c95\""
Sep 16 14:20:08.263546 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.263526    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"]
Sep 16 14:20:08.288224 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.288196    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:08.380666 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.380632    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.380811 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.380673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.380811 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.380690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.380811 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.380748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/543282fb-d0c6-4789-8e73-5d51a14edd5c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.380811 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.380784    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.380811 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.380805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.380972 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.380829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.380972 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.380899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.380972 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.380919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkgdl\" (UniqueName: \"kubernetes.io/projected/543282fb-d0c6-4789-8e73-5d51a14edd5c-kube-api-access-rkgdl\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.393930 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.393904    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:08.481784 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.481749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.481784 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.481785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.482009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.481820    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/543282fb-d0c6-4789-8e73-5d51a14edd5c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.482009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.481848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.482009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.481875    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.482009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.481904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.482009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.481975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.482009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.482006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkgdl\" (UniqueName: \"kubernetes.io/projected/543282fb-d0c6-4789-8e73-5d51a14edd5c-kube-api-access-rkgdl\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.482367 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.482056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.482431 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.482376    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.482599 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.482571    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.482690 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.482572    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.482690 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.482625    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.483020 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.482998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/543282fb-d0c6-4789-8e73-5d51a14edd5c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.484590 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.484568    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.485252 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.485216    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.490010 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.489978    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.490579 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.490556    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkgdl\" (UniqueName: \"kubernetes.io/projected/543282fb-d0c6-4789-8e73-5d51a14edd5c-kube-api-access-rkgdl\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bct8mpb\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.563054 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.563031    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:08.844754 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.844730    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"]
Sep 16 14:20:08.847433 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:20:08.847405    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543282fb_d0c6_4789_8e73_5d51a14edd5c.slice/crio-01624ababf7882322fe58d4d39e54dcf61b424f0d269587c2659b7f29c37b073 WatchSource:0}: Error finding container 01624ababf7882322fe58d4d39e54dcf61b424f0d269587c2659b7f29c37b073: Status 404 returned error can't find the container with id 01624ababf7882322fe58d4d39e54dcf61b424f0d269587c2659b7f29c37b073
Sep 16 14:20:08.922336 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.922299    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:08.990151 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.990102    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fp8dv"]
Sep 16 14:20:08.994627 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.994605    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv"
Sep 16 14:20:08.997918 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:08.997897    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4lrjm\""
Sep 16 14:20:09.005396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.005375    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 16 14:20:09.013062 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.013034    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fp8dv"]
Sep 16 14:20:09.016104 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.016067    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:09.087106 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.087075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-494lg\" (UniqueName: \"kubernetes.io/projected/773573a0-e952-47ed-a1a7-0dd0e8afa4c3-kube-api-access-494lg\") pod \"odh-model-controller-7998c67dc4-fp8dv\" (UID: \"773573a0-e952-47ed-a1a7-0dd0e8afa4c3\") " pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv"
Sep 16 14:20:09.087280 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.087122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/773573a0-e952-47ed-a1a7-0dd0e8afa4c3-cert\") pod \"odh-model-controller-7998c67dc4-fp8dv\" (UID: \"773573a0-e952-47ed-a1a7-0dd0e8afa4c3\") " pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv"
Sep 16 14:20:09.123108 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.123029    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:09.188066 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.188022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-494lg\" (UniqueName: \"kubernetes.io/projected/773573a0-e952-47ed-a1a7-0dd0e8afa4c3-kube-api-access-494lg\") pod \"odh-model-controller-7998c67dc4-fp8dv\" (UID: \"773573a0-e952-47ed-a1a7-0dd0e8afa4c3\") " pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv"
Sep 16 14:20:09.188273 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.188085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/773573a0-e952-47ed-a1a7-0dd0e8afa4c3-cert\") pod \"odh-model-controller-7998c67dc4-fp8dv\" (UID: \"773573a0-e952-47ed-a1a7-0dd0e8afa4c3\") " pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv"
Sep 16 14:20:09.190724 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.190695    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/773573a0-e952-47ed-a1a7-0dd0e8afa4c3-cert\") pod \"odh-model-controller-7998c67dc4-fp8dv\" (UID: \"773573a0-e952-47ed-a1a7-0dd0e8afa4c3\") " pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv"
Sep 16 14:20:09.199361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.199328    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-494lg\" (UniqueName: \"kubernetes.io/projected/773573a0-e952-47ed-a1a7-0dd0e8afa4c3-kube-api-access-494lg\") pod \"odh-model-controller-7998c67dc4-fp8dv\" (UID: \"773573a0-e952-47ed-a1a7-0dd0e8afa4c3\") " pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv"
Sep 16 14:20:09.218336 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.218288    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:09.305422 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.305383    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv"
Sep 16 14:20:09.536544 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.536502    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb" event={"ID":"543282fb-d0c6-4789-8e73-5d51a14edd5c","Type":"ContainerStarted","Data":"01624ababf7882322fe58d4d39e54dcf61b424f0d269587c2659b7f29c37b073"}
Sep 16 14:20:09.584617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.584582    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fp8dv"]
Sep 16 14:20:09.587370 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:20:09.587343    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773573a0_e952_47ed_a1a7_0dd0e8afa4c3.slice/crio-ed50ce2e11ae7e3af2eb9a0d60a9befaf927ec60e4ad3e847f4f31da149846b1 WatchSource:0}: Error finding container ed50ce2e11ae7e3af2eb9a0d60a9befaf927ec60e4ad3e847f4f31da149846b1: Status 404 returned error can't find the container with id ed50ce2e11ae7e3af2eb9a0d60a9befaf927ec60e4ad3e847f4f31da149846b1
Sep 16 14:20:09.598291 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.598262    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:09.615147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.615121    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-69v4j"]
Sep 16 14:20:09.619340 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.619319    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-69v4j"
Sep 16 14:20:09.621968 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.621939    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 16 14:20:09.622077 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.622014    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-fjdqd\""
Sep 16 14:20:09.630076 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.630052    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-69v4j"]
Sep 16 14:20:09.693448 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.693412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqnp5\" (UniqueName: \"kubernetes.io/projected/fd29b262-0879-42b7-b202-848228edd0d0-kube-api-access-pqnp5\") pod \"model-serving-api-54d89bd5fc-69v4j\" (UID: \"fd29b262-0879-42b7-b202-848228edd0d0\") " pod="opendatahub/model-serving-api-54d89bd5fc-69v4j"
Sep 16 14:20:09.693618 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.693455    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd29b262-0879-42b7-b202-848228edd0d0-tls-certs\") pod \"model-serving-api-54d89bd5fc-69v4j\" (UID: \"fd29b262-0879-42b7-b202-848228edd0d0\") " pod="opendatahub/model-serving-api-54d89bd5fc-69v4j"
Sep 16 14:20:09.794767 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.794685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqnp5\" (UniqueName: \"kubernetes.io/projected/fd29b262-0879-42b7-b202-848228edd0d0-kube-api-access-pqnp5\") pod \"model-serving-api-54d89bd5fc-69v4j\" (UID: \"fd29b262-0879-42b7-b202-848228edd0d0\") " pod="opendatahub/model-serving-api-54d89bd5fc-69v4j"
Sep 16 14:20:09.794767 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.794726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd29b262-0879-42b7-b202-848228edd0d0-tls-certs\") pod \"model-serving-api-54d89bd5fc-69v4j\" (UID: \"fd29b262-0879-42b7-b202-848228edd0d0\") " pod="opendatahub/model-serving-api-54d89bd5fc-69v4j"
Sep 16 14:20:09.794951 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:20:09.794849    2582 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 16 14:20:09.794951 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:20:09.794918    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd29b262-0879-42b7-b202-848228edd0d0-tls-certs podName:fd29b262-0879-42b7-b202-848228edd0d0 nodeName:}" failed. No retries permitted until 2026-09-16 14:20:10.294897609 +0000 UTC m=+329.588586081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/fd29b262-0879-42b7-b202-848228edd0d0-tls-certs") pod "model-serving-api-54d89bd5fc-69v4j" (UID: "fd29b262-0879-42b7-b202-848228edd0d0") : secret "model-serving-api-tls" not found
Sep 16 14:20:09.804258 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:09.804208    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqnp5\" (UniqueName: \"kubernetes.io/projected/fd29b262-0879-42b7-b202-848228edd0d0-kube-api-access-pqnp5\") pod \"model-serving-api-54d89bd5fc-69v4j\" (UID: \"fd29b262-0879-42b7-b202-848228edd0d0\") " pod="opendatahub/model-serving-api-54d89bd5fc-69v4j"
Sep 16 14:20:10.169531 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:10.169450    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:10.299205 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:10.299164    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd29b262-0879-42b7-b202-848228edd0d0-tls-certs\") pod \"model-serving-api-54d89bd5fc-69v4j\" (UID: \"fd29b262-0879-42b7-b202-848228edd0d0\") " pod="opendatahub/model-serving-api-54d89bd5fc-69v4j"
Sep 16 14:20:10.305409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:10.305371    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd29b262-0879-42b7-b202-848228edd0d0-tls-certs\") pod \"model-serving-api-54d89bd5fc-69v4j\" (UID: \"fd29b262-0879-42b7-b202-848228edd0d0\") " pod="opendatahub/model-serving-api-54d89bd5fc-69v4j"
Sep 16 14:20:10.530160 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:10.529986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-69v4j"
Sep 16 14:20:10.545926 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:10.545890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv" event={"ID":"773573a0-e952-47ed-a1a7-0dd0e8afa4c3","Type":"ContainerStarted","Data":"ed50ce2e11ae7e3af2eb9a0d60a9befaf927ec60e4ad3e847f4f31da149846b1"}
Sep 16 14:20:10.854060 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:10.854022    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-69v4j"]
Sep 16 14:20:10.854463 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:20:10.854408    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd29b262_0879_42b7_b202_848228edd0d0.slice/crio-ef81f2ef78fb9c448fdab52b1c72820ad326701b97ea9dba954c64543f251ab9 WatchSource:0}: Error finding container ef81f2ef78fb9c448fdab52b1c72820ad326701b97ea9dba954c64543f251ab9: Status 404 returned error can't find the container with id ef81f2ef78fb9c448fdab52b1c72820ad326701b97ea9dba954c64543f251ab9
Sep 16 14:20:11.552859 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:11.552819    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-69v4j" event={"ID":"fd29b262-0879-42b7-b202-848228edd0d0","Type":"ContainerStarted","Data":"ef81f2ef78fb9c448fdab52b1c72820ad326701b97ea9dba954c64543f251ab9"}
Sep 16 14:20:14.284621 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:14.284575    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:20:14.284993 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:14.284662    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:20:14.284993 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:14.284699    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:20:14.569654 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:14.569616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb" event={"ID":"543282fb-d0c6-4789-8e73-5d51a14edd5c","Type":"ContainerStarted","Data":"e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2"}
Sep 16 14:20:14.571255 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:14.571210    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-69v4j" event={"ID":"fd29b262-0879-42b7-b202-848228edd0d0","Type":"ContainerStarted","Data":"563bb874bf8ebcdf8fcefedd9fd5c4b8824bec8f635a2feba78775e96a5bbd7b"}
Sep 16 14:20:14.571401 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:14.571291    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-69v4j"
Sep 16 14:20:14.572854 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:14.572832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv" event={"ID":"773573a0-e952-47ed-a1a7-0dd0e8afa4c3","Type":"ContainerStarted","Data":"79cfc92347f6659e7c9a4e6a0f8232515f3c2eba65025c0b3d72516b92bc6eef"}
Sep 16 14:20:14.572972 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:14.572960    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv"
Sep 16 14:20:14.641867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:14.641806    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb" podStartSLOduration=1.207039257 podStartE2EDuration="6.641783459s" totalImagesPullingTime="5.434744202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:20:14.611947827 +0000 UTC m=+333.905636309" watchObservedRunningTime="2026-09-16 14:20:14.641783459 +0000 UTC m=+333.935471940"
Sep 16 14:20:14.642050 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:14.641965    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv" podStartSLOduration=2.337483362 podStartE2EDuration="6.641957064s" totalImagesPullingTime="4.304473702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:20:14.64137212 +0000 UTC m=+333.935060599" watchObservedRunningTime="2026-09-16 14:20:14.641957064 +0000 UTC m=+333.935645562"
Sep 16 14:20:14.665077 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:14.665032    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-69v4j" podStartSLOduration=2.194995569 podStartE2EDuration="5.665020506s" totalImagesPullingTime="3.470024937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:20:14.662638536 +0000 UTC m=+333.956327024" watchObservedRunningTime="2026-09-16 14:20:14.665020506 +0000 UTC m=+333.958708985"
Sep 16 14:20:15.563379 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:15.563344    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:15.564740 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:15.564704    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Sep 16 14:20:15.564863 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:15.564772    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb" podUID="543282fb-d0c6-4789-8e73-5d51a14edd5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Sep 16 14:20:16.564302 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:16.564265    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Sep 16 14:20:16.564660 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:16.564322    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb" podUID="543282fb-d0c6-4789-8e73-5d51a14edd5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Sep 16 14:20:17.558021 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.557980    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"]
Sep 16 14:20:17.561360 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.561343    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.563799 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.563774    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Sep 16 14:20:17.563883 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.563818    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb" podUID="543282fb-d0c6-4789-8e73-5d51a14edd5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Sep 16 14:20:17.567403 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.567382    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 14:20:17.567777 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.567753    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pdjgm\""
Sep 16 14:20:17.568679 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.568663    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 14:20:17.570039 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.570019    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 14:20:17.609653 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.609627    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"]
Sep 16 14:20:17.665550 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.665515    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9b9f21b3-5a2c-4e7c-8638-88172eee7385-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.665691 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.665566    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq98s\" (UniqueName: \"kubernetes.io/projected/9b9f21b3-5a2c-4e7c-8638-88172eee7385-kube-api-access-bq98s\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.665691 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.665661    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9b9f21b3-5a2c-4e7c-8638-88172eee7385-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.665764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.665694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9b9f21b3-5a2c-4e7c-8638-88172eee7385-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.665764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.665716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9b9f21b3-5a2c-4e7c-8638-88172eee7385-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.665764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.665738    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b9f21b3-5a2c-4e7c-8638-88172eee7385-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.665764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.665756    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b9f21b3-5a2c-4e7c-8638-88172eee7385-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.766502 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.766470    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq98s\" (UniqueName: \"kubernetes.io/projected/9b9f21b3-5a2c-4e7c-8638-88172eee7385-kube-api-access-bq98s\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.766688 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.766518    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9b9f21b3-5a2c-4e7c-8638-88172eee7385-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.766688 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.766546    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9b9f21b3-5a2c-4e7c-8638-88172eee7385-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.766688 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.766571    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9b9f21b3-5a2c-4e7c-8638-88172eee7385-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.766688 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.766600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b9f21b3-5a2c-4e7c-8638-88172eee7385-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.766688 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.766626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b9f21b3-5a2c-4e7c-8638-88172eee7385-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.766938 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.766701    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9b9f21b3-5a2c-4e7c-8638-88172eee7385-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.767668 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.767638    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9b9f21b3-5a2c-4e7c-8638-88172eee7385-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.768995 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.768973    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b9f21b3-5a2c-4e7c-8638-88172eee7385-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.769196 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.769166    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9b9f21b3-5a2c-4e7c-8638-88172eee7385-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.769373 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.769356    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9b9f21b3-5a2c-4e7c-8638-88172eee7385-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.769420 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.769359    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9b9f21b3-5a2c-4e7c-8638-88172eee7385-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.797830 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.797798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b9f21b3-5a2c-4e7c-8638-88172eee7385-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.798093 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.798071    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq98s\" (UniqueName: \"kubernetes.io/projected/9b9f21b3-5a2c-4e7c-8638-88172eee7385-kube-api-access-bq98s\") pod \"istiod-openshift-gateway-5677ccb49b-t8c7r\" (UID: \"9b9f21b3-5a2c-4e7c-8638-88172eee7385\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:17.871076 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:17.871019    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:18.172048 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:18.172020    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"]
Sep 16 14:20:18.174718 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:20:18.174693    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9f21b3_5a2c_4e7c_8638_88172eee7385.slice/crio-eade283a108cbfcd26298faaf1496bc714259bf27e2cd3fe65894247d65f1f10 WatchSource:0}: Error finding container eade283a108cbfcd26298faaf1496bc714259bf27e2cd3fe65894247d65f1f10: Status 404 returned error can't find the container with id eade283a108cbfcd26298faaf1496bc714259bf27e2cd3fe65894247d65f1f10
Sep 16 14:20:18.563677 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:18.563646    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Sep 16 14:20:18.563834 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:18.563709    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb" podUID="543282fb-d0c6-4789-8e73-5d51a14edd5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Sep 16 14:20:18.590615 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:18.590588    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r" event={"ID":"9b9f21b3-5a2c-4e7c-8638-88172eee7385","Type":"ContainerStarted","Data":"eade283a108cbfcd26298faaf1496bc714259bf27e2cd3fe65894247d65f1f10"}
Sep 16 14:20:19.563976 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:19.563935    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Sep 16 14:20:19.564142 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:19.563999    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb" podUID="543282fb-d0c6-4789-8e73-5d51a14edd5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Sep 16 14:20:20.256356 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:20.256322    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:20:20.256599 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:20.256390    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:20:20.563835 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:20.563803    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Sep 16 14:20:20.563971 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:20.563852    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb" podUID="543282fb-d0c6-4789-8e73-5d51a14edd5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Sep 16 14:20:20.605415 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:20.605382    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r" event={"ID":"9b9f21b3-5a2c-4e7c-8638-88172eee7385","Type":"ContainerStarted","Data":"0c24b7dad44562ec3f33e84ea38f6a8e61e0283b1acf5c011eb2d4d1ff3d0227"}
Sep 16 14:20:20.605562 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:20.605520    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:20.654140 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:20.654087    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r" podStartSLOduration=1.5752057499999998 podStartE2EDuration="3.654071758s" totalImagesPullingTime="2.078866008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:20:20.652386284 +0000 UTC m=+339.946074765" watchObservedRunningTime="2026-09-16 14:20:20.654071758 +0000 UTC m=+339.947760238"
Sep 16 14:20:20.661607 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:20.661576    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"]
Sep 16 14:20:20.661781 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:20.661756    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb" podUID="543282fb-d0c6-4789-8e73-5d51a14edd5c" containerName="istio-proxy" containerID="cri-o://e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2" gracePeriod=30
Sep 16 14:20:20.940306 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:20.940192    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:21.098154 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:21.098108    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:21.218127 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:21.218041    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:21.380878 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:21.380846    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:21.611461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:21.611433    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r"
Sep 16 14:20:22.447351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:22.447292    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:22.551094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:22.551055    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:23.563226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:23.563187    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:25.580032 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:25.580005    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fp8dv"
Sep 16 14:20:25.582153 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:25.582135    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-69v4j"
Sep 16 14:20:25.910724 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:25.910699    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:26.032414 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032383    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-token\") pod \"543282fb-d0c6-4789-8e73-5d51a14edd5c\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") "
Sep 16 14:20:26.032587 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032423    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-envoy\") pod \"543282fb-d0c6-4789-8e73-5d51a14edd5c\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") "
Sep 16 14:20:26.032587 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032446    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-podinfo\") pod \"543282fb-d0c6-4789-8e73-5d51a14edd5c\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") "
Sep 16 14:20:26.032587 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032477    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-credential-socket\") pod \"543282fb-d0c6-4789-8e73-5d51a14edd5c\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") "
Sep 16 14:20:26.032587 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032509    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-workload-certs\") pod \"543282fb-d0c6-4789-8e73-5d51a14edd5c\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") "
Sep 16 14:20:26.032587 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032566    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-data\") pod \"543282fb-d0c6-4789-8e73-5d51a14edd5c\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") "
Sep 16 14:20:26.032828 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032612    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-workload-socket\") pod \"543282fb-d0c6-4789-8e73-5d51a14edd5c\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") "
Sep 16 14:20:26.032828 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032636    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/543282fb-d0c6-4789-8e73-5d51a14edd5c-istiod-ca-cert\") pod \"543282fb-d0c6-4789-8e73-5d51a14edd5c\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") "
Sep 16 14:20:26.032828 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032666    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkgdl\" (UniqueName: \"kubernetes.io/projected/543282fb-d0c6-4789-8e73-5d51a14edd5c-kube-api-access-rkgdl\") pod \"543282fb-d0c6-4789-8e73-5d51a14edd5c\" (UID: \"543282fb-d0c6-4789-8e73-5d51a14edd5c\") "
Sep 16 14:20:26.032828 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032743    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "543282fb-d0c6-4789-8e73-5d51a14edd5c" (UID: "543282fb-d0c6-4789-8e73-5d51a14edd5c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:20:26.032828 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032764    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "543282fb-d0c6-4789-8e73-5d51a14edd5c" (UID: "543282fb-d0c6-4789-8e73-5d51a14edd5c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:20:26.033138 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032833    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-data" (OuterVolumeSpecName: "istio-data") pod "543282fb-d0c6-4789-8e73-5d51a14edd5c" (UID: "543282fb-d0c6-4789-8e73-5d51a14edd5c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:20:26.033138 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032938    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "543282fb-d0c6-4789-8e73-5d51a14edd5c" (UID: "543282fb-d0c6-4789-8e73-5d51a14edd5c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:20:26.033138 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032955    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-data\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:20:26.033138 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032974    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-credential-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:20:26.033138 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.032990    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-workload-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:20:26.033138 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.033089    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543282fb-d0c6-4789-8e73-5d51a14edd5c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "543282fb-d0c6-4789-8e73-5d51a14edd5c" (UID: "543282fb-d0c6-4789-8e73-5d51a14edd5c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:20:26.034777 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.034746    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "543282fb-d0c6-4789-8e73-5d51a14edd5c" (UID: "543282fb-d0c6-4789-8e73-5d51a14edd5c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:20:26.034893 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.034808    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/543282fb-d0c6-4789-8e73-5d51a14edd5c-kube-api-access-rkgdl" (OuterVolumeSpecName: "kube-api-access-rkgdl") pod "543282fb-d0c6-4789-8e73-5d51a14edd5c" (UID: "543282fb-d0c6-4789-8e73-5d51a14edd5c"). InnerVolumeSpecName "kube-api-access-rkgdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:20:26.034893 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.034826    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-token" (OuterVolumeSpecName: "istio-token") pod "543282fb-d0c6-4789-8e73-5d51a14edd5c" (UID: "543282fb-d0c6-4789-8e73-5d51a14edd5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:20:26.034893 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.034850    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "543282fb-d0c6-4789-8e73-5d51a14edd5c" (UID: "543282fb-d0c6-4789-8e73-5d51a14edd5c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:20:26.133745 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.133716    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-token\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:20:26.133745 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.133741    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-envoy\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:20:26.133745 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.133750    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/543282fb-d0c6-4789-8e73-5d51a14edd5c-istio-podinfo\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:20:26.133921 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.133759    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/543282fb-d0c6-4789-8e73-5d51a14edd5c-workload-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:20:26.133921 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.133768    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/543282fb-d0c6-4789-8e73-5d51a14edd5c-istiod-ca-cert\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:20:26.133921 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.133776    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkgdl\" (UniqueName: \"kubernetes.io/projected/543282fb-d0c6-4789-8e73-5d51a14edd5c-kube-api-access-rkgdl\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:20:26.633175 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.633142    2582 generic.go:356] "Generic (PLEG): container finished" podID="543282fb-d0c6-4789-8e73-5d51a14edd5c" containerID="e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2" exitCode=0
Sep 16 14:20:26.633695 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.633183    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"
Sep 16 14:20:26.633695 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.633223    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb" event={"ID":"543282fb-d0c6-4789-8e73-5d51a14edd5c","Type":"ContainerDied","Data":"e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2"}
Sep 16 14:20:26.633695 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.633289    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb" event={"ID":"543282fb-d0c6-4789-8e73-5d51a14edd5c","Type":"ContainerDied","Data":"01624ababf7882322fe58d4d39e54dcf61b424f0d269587c2659b7f29c37b073"}
Sep 16 14:20:26.633695 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.633313    2582 scope.go:117] "RemoveContainer" containerID="e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2"
Sep 16 14:20:26.642116 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.642099    2582 scope.go:117] "RemoveContainer" containerID="e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2"
Sep 16 14:20:26.642470 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:20:26.642448    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2\": container with ID starting with e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2 not found: ID does not exist" containerID="e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2"
Sep 16 14:20:26.642534 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.642479    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2"} err="failed to get container status \"e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2\": rpc error: code = NotFound desc = could not find container \"e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2\": container with ID starting with e1713b6b57d287b4fe4fbdb3df02a8906c5757d42b8b3fad7eac5b41877fd7d2 not found: ID does not exist"
Sep 16 14:20:26.669265 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.669228    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"]
Sep 16 14:20:26.676087 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:26.676061    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb"]
Sep 16 14:20:27.180311 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:27.180274    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="543282fb-d0c6-4789-8e73-5d51a14edd5c" path="/var/lib/kubelet/pods/543282fb-d0c6-4789-8e73-5d51a14edd5c/volumes"
Sep 16 14:20:49.226720 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.226687    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56887f46f-4nnpw"]
Sep 16 14:20:49.227083 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.226953    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="543282fb-d0c6-4789-8e73-5d51a14edd5c" containerName="istio-proxy"
Sep 16 14:20:49.227083 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.226963    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="543282fb-d0c6-4789-8e73-5d51a14edd5c" containerName="istio-proxy"
Sep 16 14:20:49.227083 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.227011    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="543282fb-d0c6-4789-8e73-5d51a14edd5c" containerName="istio-proxy"
Sep 16 14:20:49.236193 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.236168    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.238852 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.238830    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gqfcf\""
Sep 16 14:20:49.239013 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.238996    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 14:20:49.240179 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.240161    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 14:20:49.240308 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.240208    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 14:20:49.240308 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.240252    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 14:20:49.240308 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.240275    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 14:20:49.240490 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.240311    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 14:20:49.240490 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.240214    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 14:20:49.245169 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.245149    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 14:20:49.246643 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.246622    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56887f46f-4nnpw"]
Sep 16 14:20:49.291395 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.291371    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:49.297429 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.297407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsqgg\" (UniqueName: \"kubernetes.io/projected/01bf1a48-38c4-4a27-84de-6781f20ca970-kube-api-access-lsqgg\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.297524 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.297437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01bf1a48-38c4-4a27-84de-6781f20ca970-console-serving-cert\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.297524 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.297456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01bf1a48-38c4-4a27-84de-6781f20ca970-trusted-ca-bundle\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.297524 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.297482    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01bf1a48-38c4-4a27-84de-6781f20ca970-console-oauth-config\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.297627 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.297530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01bf1a48-38c4-4a27-84de-6781f20ca970-service-ca\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.297627 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.297562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01bf1a48-38c4-4a27-84de-6781f20ca970-oauth-serving-cert\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.297627 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.297590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01bf1a48-38c4-4a27-84de-6781f20ca970-console-config\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.393023 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.393001    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:20:49.398295 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.398275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsqgg\" (UniqueName: \"kubernetes.io/projected/01bf1a48-38c4-4a27-84de-6781f20ca970-kube-api-access-lsqgg\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.398361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.398304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01bf1a48-38c4-4a27-84de-6781f20ca970-console-serving-cert\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.398361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.398326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01bf1a48-38c4-4a27-84de-6781f20ca970-trusted-ca-bundle\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.398469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.398450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01bf1a48-38c4-4a27-84de-6781f20ca970-console-oauth-config\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.398505 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.398495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01bf1a48-38c4-4a27-84de-6781f20ca970-service-ca\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.398552 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.398531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01bf1a48-38c4-4a27-84de-6781f20ca970-oauth-serving-cert\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.398608 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.398574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01bf1a48-38c4-4a27-84de-6781f20ca970-console-config\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.399205 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.399185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01bf1a48-38c4-4a27-84de-6781f20ca970-console-config\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.399314 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.399211    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01bf1a48-38c4-4a27-84de-6781f20ca970-service-ca\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.399314 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.399277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01bf1a48-38c4-4a27-84de-6781f20ca970-oauth-serving-cert\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.399385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.399355    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01bf1a48-38c4-4a27-84de-6781f20ca970-trusted-ca-bundle\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.400664 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.400646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01bf1a48-38c4-4a27-84de-6781f20ca970-console-serving-cert\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.400865 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.400835    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01bf1a48-38c4-4a27-84de-6781f20ca970-console-oauth-config\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.407499 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.407477    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsqgg\" (UniqueName: \"kubernetes.io/projected/01bf1a48-38c4-4a27-84de-6781f20ca970-kube-api-access-lsqgg\") pod \"console-56887f46f-4nnpw\" (UID: \"01bf1a48-38c4-4a27-84de-6781f20ca970\") " pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.546060 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.546033    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:49.819744 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:49.819718    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56887f46f-4nnpw"]
Sep 16 14:20:49.821780 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:20:49.821752    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01bf1a48_38c4_4a27_84de_6781f20ca970.slice/crio-257fc4c8c5a6a0e8eb7fe618f2ea383e59baeaf51eb2ba96f39bbfb196e23c0f WatchSource:0}: Error finding container 257fc4c8c5a6a0e8eb7fe618f2ea383e59baeaf51eb2ba96f39bbfb196e23c0f: Status 404 returned error can't find the container with id 257fc4c8c5a6a0e8eb7fe618f2ea383e59baeaf51eb2ba96f39bbfb196e23c0f
Sep 16 14:20:50.742379 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:50.742345    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56887f46f-4nnpw" event={"ID":"01bf1a48-38c4-4a27-84de-6781f20ca970","Type":"ContainerStarted","Data":"b4528338e248cadb4d1878762a64137b3416b1f847c847ea0816c5862b13f84c"}
Sep 16 14:20:50.742738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:50.742398    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56887f46f-4nnpw" event={"ID":"01bf1a48-38c4-4a27-84de-6781f20ca970","Type":"ContainerStarted","Data":"257fc4c8c5a6a0e8eb7fe618f2ea383e59baeaf51eb2ba96f39bbfb196e23c0f"}
Sep 16 14:20:50.765361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:50.765314    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56887f46f-4nnpw" podStartSLOduration=1.7652971160000002 podStartE2EDuration="1.765297116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:20:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:20:50.76283371 +0000 UTC m=+370.056522190" watchObservedRunningTime="2026-09-16 14:20:50.765297116 +0000 UTC m=+370.058985596"
Sep 16 14:20:59.546629 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:59.546597    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:59.547169 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:59.546644    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:59.551506 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:59.551483    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:20:59.788604 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:20:59.788577    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56887f46f-4nnpw"
Sep 16 14:21:00.001154 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:00.001040    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:00.099927 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:00.099898    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:00.200965 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:00.200934    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:10.058119 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:10.058082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:10.158482 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:10.158450    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:14.363970 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.363936    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"]
Sep 16 14:21:14.366408 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.366390    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:14.369201 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.369174    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 14:21:14.369516 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.369497    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 14:21:14.370135 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.370116    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gdfsj\""
Sep 16 14:21:14.380140 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.380111    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"]
Sep 16 14:21:14.456404 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.456372    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"]
Sep 16 14:21:14.458961 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.458947    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:14.469430 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.469410    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"]
Sep 16 14:21:14.488039 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.488017    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ttf9\" (UniqueName: \"kubernetes.io/projected/4774a995-14ba-4ede-b3bb-a66d92a31cb7-kube-api-access-6ttf9\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf\" (UID: \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:14.488134 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.488068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4774a995-14ba-4ede-b3bb-a66d92a31cb7-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf\" (UID: \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:14.488180 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.488131    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4774a995-14ba-4ede-b3bb-a66d92a31cb7-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf\" (UID: \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:14.551644 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.551612    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"]
Sep 16 14:21:14.553948 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.553932    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:14.564777 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.564754    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"]
Sep 16 14:21:14.588755 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.588724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh\" (UID: \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:14.588890 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.588761    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4774a995-14ba-4ede-b3bb-a66d92a31cb7-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf\" (UID: \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:14.588890 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.588789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh\" (UID: \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:14.588890 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.588841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4774a995-14ba-4ede-b3bb-a66d92a31cb7-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf\" (UID: \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:14.588890 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.588871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dp7f\" (UniqueName: \"kubernetes.io/projected/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-kube-api-access-4dp7f\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh\" (UID: \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:14.589108 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.588893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ttf9\" (UniqueName: \"kubernetes.io/projected/4774a995-14ba-4ede-b3bb-a66d92a31cb7-kube-api-access-6ttf9\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf\" (UID: \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:14.589191 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.589172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4774a995-14ba-4ede-b3bb-a66d92a31cb7-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf\" (UID: \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:14.589265 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.589184    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4774a995-14ba-4ede-b3bb-a66d92a31cb7-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf\" (UID: \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:14.598425 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.598401    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ttf9\" (UniqueName: \"kubernetes.io/projected/4774a995-14ba-4ede-b3bb-a66d92a31cb7-kube-api-access-6ttf9\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf\" (UID: \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:14.649257 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.649174    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"]
Sep 16 14:21:14.651599 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.651582    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:14.662793 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.662771    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"]
Sep 16 14:21:14.675675 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.675656    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:14.689286 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.689261    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0949a152-ebb0-4889-9fcd-d6acc6c65a63-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww\" (UID: \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:14.689382 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.689310    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dp7f\" (UniqueName: \"kubernetes.io/projected/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-kube-api-access-4dp7f\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh\" (UID: \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:14.689382 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.689334    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr8g7\" (UniqueName: \"kubernetes.io/projected/0949a152-ebb0-4889-9fcd-d6acc6c65a63-kube-api-access-vr8g7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww\" (UID: \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:14.689498 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.689396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh\" (UID: \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:14.689498 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.689422    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0949a152-ebb0-4889-9fcd-d6acc6c65a63-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww\" (UID: \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:14.689601 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.689510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh\" (UID: \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:14.689765 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.689747    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh\" (UID: \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:14.689817 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.689777    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh\" (UID: \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:14.699367 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.699347    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dp7f\" (UniqueName: \"kubernetes.io/projected/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-kube-api-access-4dp7f\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh\" (UID: \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:14.767720 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.767677    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:14.790515 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.790480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0949a152-ebb0-4889-9fcd-d6acc6c65a63-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww\" (UID: \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:14.790665 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.790531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr8g7\" (UniqueName: \"kubernetes.io/projected/0949a152-ebb0-4889-9fcd-d6acc6c65a63-kube-api-access-vr8g7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww\" (UID: \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:14.790730 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.790653    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjrgj\" (UniqueName: \"kubernetes.io/projected/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-kube-api-access-xjrgj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn\" (UID: \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:14.790786 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.790755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn\" (UID: \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:14.790844 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.790803    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn\" (UID: \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:14.790895 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.790844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0949a152-ebb0-4889-9fcd-d6acc6c65a63-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww\" (UID: \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:14.790973 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.790954    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0949a152-ebb0-4889-9fcd-d6acc6c65a63-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww\" (UID: \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:14.791156 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.791137    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0949a152-ebb0-4889-9fcd-d6acc6c65a63-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww\" (UID: \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:14.799945 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.799921    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr8g7\" (UniqueName: \"kubernetes.io/projected/0949a152-ebb0-4889-9fcd-d6acc6c65a63-kube-api-access-vr8g7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww\" (UID: \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:14.862995 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.862972    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:14.891714 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.891670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjrgj\" (UniqueName: \"kubernetes.io/projected/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-kube-api-access-xjrgj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn\" (UID: \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:14.891880 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.891751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn\" (UID: \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:14.891880 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.891788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn\" (UID: \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:14.892339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.892282    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn\" (UID: \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:14.892501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.892473    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn\" (UID: \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:14.901984 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.901887    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjrgj\" (UniqueName: \"kubernetes.io/projected/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-kube-api-access-xjrgj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn\" (UID: \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:14.949753 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.949729    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"]
Sep 16 14:21:14.952172 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:21:14.952139    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4774a995_14ba_4ede_b3bb_a66d92a31cb7.slice/crio-091a97ee92eb9e6d99ec2a1674d18354b37d68e31f42a4bd1fa49db891e08993 WatchSource:0}: Error finding container 091a97ee92eb9e6d99ec2a1674d18354b37d68e31f42a4bd1fa49db891e08993: Status 404 returned error can't find the container with id 091a97ee92eb9e6d99ec2a1674d18354b37d68e31f42a4bd1fa49db891e08993
Sep 16 14:21:14.960562 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:14.960544    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:15.046526 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.046500    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"]
Sep 16 14:21:15.049133 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:21:15.049107    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79317b6_090d_4d2e_99bf_e4cd68b8d36a.slice/crio-8bab8b9348e72a82229160256cc2c541fcac44ef44127fc2ca1fe3dd3fc4f392 WatchSource:0}: Error finding container 8bab8b9348e72a82229160256cc2c541fcac44ef44127fc2ca1fe3dd3fc4f392: Status 404 returned error can't find the container with id 8bab8b9348e72a82229160256cc2c541fcac44ef44127fc2ca1fe3dd3fc4f392
Sep 16 14:21:15.140718 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.140690    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"]
Sep 16 14:21:15.143289 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:21:15.143263    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0949a152_ebb0_4889_9fcd_d6acc6c65a63.slice/crio-b5593e4a8db6c03e83de554dbf0631c911a5af0a65be83315650b360fc4d524c WatchSource:0}: Error finding container b5593e4a8db6c03e83de554dbf0631c911a5af0a65be83315650b360fc4d524c: Status 404 returned error can't find the container with id b5593e4a8db6c03e83de554dbf0631c911a5af0a65be83315650b360fc4d524c
Sep 16 14:21:15.244422 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.244391    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"]
Sep 16 14:21:15.247254 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:21:15.247213    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91063e1f_ab78_46ee_8be9_3071c0ca2c6a.slice/crio-c7621ec36caba9ab04e0731ba118f384efffcfc2b8fbc35eed6c8e20fed5c15c WatchSource:0}: Error finding container c7621ec36caba9ab04e0731ba118f384efffcfc2b8fbc35eed6c8e20fed5c15c: Status 404 returned error can't find the container with id c7621ec36caba9ab04e0731ba118f384efffcfc2b8fbc35eed6c8e20fed5c15c
Sep 16 14:21:15.854795 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.854759    2582 generic.go:356] "Generic (PLEG): container finished" podID="0949a152-ebb0-4889-9fcd-d6acc6c65a63" containerID="63f187924dc3cc6e012bc26d26ee3916dcee6f37c87b55c1bb72ff6c6d479beb" exitCode=0
Sep 16 14:21:15.855168 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.854843    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww" event={"ID":"0949a152-ebb0-4889-9fcd-d6acc6c65a63","Type":"ContainerDied","Data":"63f187924dc3cc6e012bc26d26ee3916dcee6f37c87b55c1bb72ff6c6d479beb"}
Sep 16 14:21:15.855168 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.854891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww" event={"ID":"0949a152-ebb0-4889-9fcd-d6acc6c65a63","Type":"ContainerStarted","Data":"b5593e4a8db6c03e83de554dbf0631c911a5af0a65be83315650b360fc4d524c"}
Sep 16 14:21:15.856507 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.856483    2582 generic.go:356] "Generic (PLEG): container finished" podID="a79317b6-090d-4d2e-99bf-e4cd68b8d36a" containerID="704902337d027c17b5e676b6c1626bfb08f99c4cab43086e4726de5dad8f7fc1" exitCode=0
Sep 16 14:21:15.856568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.856515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh" event={"ID":"a79317b6-090d-4d2e-99bf-e4cd68b8d36a","Type":"ContainerDied","Data":"704902337d027c17b5e676b6c1626bfb08f99c4cab43086e4726de5dad8f7fc1"}
Sep 16 14:21:15.856614 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.856574    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh" event={"ID":"a79317b6-090d-4d2e-99bf-e4cd68b8d36a","Type":"ContainerStarted","Data":"8bab8b9348e72a82229160256cc2c541fcac44ef44127fc2ca1fe3dd3fc4f392"}
Sep 16 14:21:15.858174 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.858152    2582 generic.go:356] "Generic (PLEG): container finished" podID="4774a995-14ba-4ede-b3bb-a66d92a31cb7" containerID="44eae03c60f39a0441ee8573d09ed3ae86ac80fa9a20696b9c0bd8d0f85e5cef" exitCode=0
Sep 16 14:21:15.858273 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.858251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf" event={"ID":"4774a995-14ba-4ede-b3bb-a66d92a31cb7","Type":"ContainerDied","Data":"44eae03c60f39a0441ee8573d09ed3ae86ac80fa9a20696b9c0bd8d0f85e5cef"}
Sep 16 14:21:15.858348 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.858290    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf" event={"ID":"4774a995-14ba-4ede-b3bb-a66d92a31cb7","Type":"ContainerStarted","Data":"091a97ee92eb9e6d99ec2a1674d18354b37d68e31f42a4bd1fa49db891e08993"}
Sep 16 14:21:15.859899 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.859879    2582 generic.go:356] "Generic (PLEG): container finished" podID="91063e1f-ab78-46ee-8be9-3071c0ca2c6a" containerID="329bea522f9630988061afbdafab30fe91c7061c6baa2755cbbd6a27ae775ec2" exitCode=0
Sep 16 14:21:15.859987 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.859913    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn" event={"ID":"91063e1f-ab78-46ee-8be9-3071c0ca2c6a","Type":"ContainerDied","Data":"329bea522f9630988061afbdafab30fe91c7061c6baa2755cbbd6a27ae775ec2"}
Sep 16 14:21:15.859987 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:15.859937    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn" event={"ID":"91063e1f-ab78-46ee-8be9-3071c0ca2c6a","Type":"ContainerStarted","Data":"c7621ec36caba9ab04e0731ba118f384efffcfc2b8fbc35eed6c8e20fed5c15c"}
Sep 16 14:21:16.866654 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:16.866622    2582 generic.go:356] "Generic (PLEG): container finished" podID="a79317b6-090d-4d2e-99bf-e4cd68b8d36a" containerID="63560e2d35fd0a27aee5474e14e47b0733a323f202d3c06f2f0004cb87f32826" exitCode=0
Sep 16 14:21:16.866996 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:16.866699    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh" event={"ID":"a79317b6-090d-4d2e-99bf-e4cd68b8d36a","Type":"ContainerDied","Data":"63560e2d35fd0a27aee5474e14e47b0733a323f202d3c06f2f0004cb87f32826"}
Sep 16 14:21:16.868766 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:16.868739    2582 generic.go:356] "Generic (PLEG): container finished" podID="4774a995-14ba-4ede-b3bb-a66d92a31cb7" containerID="eba39204d8c3ae28f0991d5e4b057aa97159f132637fda4224650704d4d1901d" exitCode=0
Sep 16 14:21:16.868846 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:16.868820    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf" event={"ID":"4774a995-14ba-4ede-b3bb-a66d92a31cb7","Type":"ContainerDied","Data":"eba39204d8c3ae28f0991d5e4b057aa97159f132637fda4224650704d4d1901d"}
Sep 16 14:21:16.870831 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:16.870758    2582 generic.go:356] "Generic (PLEG): container finished" podID="91063e1f-ab78-46ee-8be9-3071c0ca2c6a" containerID="d773f61817604c935cdf3820dec4386e353b4cb0c620f00b9d995b25bf22d485" exitCode=0
Sep 16 14:21:16.870892 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:16.870835    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn" event={"ID":"91063e1f-ab78-46ee-8be9-3071c0ca2c6a","Type":"ContainerDied","Data":"d773f61817604c935cdf3820dec4386e353b4cb0c620f00b9d995b25bf22d485"}
Sep 16 14:21:16.872653 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:16.872632    2582 generic.go:356] "Generic (PLEG): container finished" podID="0949a152-ebb0-4889-9fcd-d6acc6c65a63" containerID="8a0dea944ee9c280ab30ed25dc9471e2721378d469fbfdaff7055236d39f0de6" exitCode=0
Sep 16 14:21:16.872746 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:16.872658    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww" event={"ID":"0949a152-ebb0-4889-9fcd-d6acc6c65a63","Type":"ContainerDied","Data":"8a0dea944ee9c280ab30ed25dc9471e2721378d469fbfdaff7055236d39f0de6"}
Sep 16 14:21:17.879198 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:17.879118    2582 generic.go:356] "Generic (PLEG): container finished" podID="91063e1f-ab78-46ee-8be9-3071c0ca2c6a" containerID="0a845349a605d6c394537d0b980ab037b722de28b77c148e9864926a3e867f96" exitCode=0
Sep 16 14:21:17.879616 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:17.879209    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn" event={"ID":"91063e1f-ab78-46ee-8be9-3071c0ca2c6a","Type":"ContainerDied","Data":"0a845349a605d6c394537d0b980ab037b722de28b77c148e9864926a3e867f96"}
Sep 16 14:21:17.881317 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:17.881297    2582 generic.go:356] "Generic (PLEG): container finished" podID="0949a152-ebb0-4889-9fcd-d6acc6c65a63" containerID="6dc0cbf727f160dc7fd9790990019b9bfa847af1fcb7476ac2748b9079077ed4" exitCode=0
Sep 16 14:21:17.881396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:17.881377    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww" event={"ID":"0949a152-ebb0-4889-9fcd-d6acc6c65a63","Type":"ContainerDied","Data":"6dc0cbf727f160dc7fd9790990019b9bfa847af1fcb7476ac2748b9079077ed4"}
Sep 16 14:21:17.883212 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:17.883195    2582 generic.go:356] "Generic (PLEG): container finished" podID="a79317b6-090d-4d2e-99bf-e4cd68b8d36a" containerID="4ad5fbcdfa6273bdda0682bb2246e82827a6bea52e52bb57e028bd4cac4886c6" exitCode=0
Sep 16 14:21:17.883286 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:17.883268    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh" event={"ID":"a79317b6-090d-4d2e-99bf-e4cd68b8d36a","Type":"ContainerDied","Data":"4ad5fbcdfa6273bdda0682bb2246e82827a6bea52e52bb57e028bd4cac4886c6"}
Sep 16 14:21:17.885246 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:17.885222    2582 generic.go:356] "Generic (PLEG): container finished" podID="4774a995-14ba-4ede-b3bb-a66d92a31cb7" containerID="5cea7f5f6c361e401a6908494ad3229071acbb1f197a67eb51bc7e41de5c4f38" exitCode=0
Sep 16 14:21:17.885330 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:17.885260    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf" event={"ID":"4774a995-14ba-4ede-b3bb-a66d92a31cb7","Type":"ContainerDied","Data":"5cea7f5f6c361e401a6908494ad3229071acbb1f197a67eb51bc7e41de5c4f38"}
Sep 16 14:21:19.008174 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.008149    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:19.049070 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.049046    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:19.085371 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.085352    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:19.088292 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.088271    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:19.123289 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.123263    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dp7f\" (UniqueName: \"kubernetes.io/projected/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-kube-api-access-4dp7f\") pod \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\" (UID: \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\") "
Sep 16 14:21:19.123396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.123325    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-bundle\") pod \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\" (UID: \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\") "
Sep 16 14:21:19.123396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.123343    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjrgj\" (UniqueName: \"kubernetes.io/projected/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-kube-api-access-xjrgj\") pod \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\" (UID: \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\") "
Sep 16 14:21:19.123396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.123359    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-bundle\") pod \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\" (UID: \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\") "
Sep 16 14:21:19.123396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.123389    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-util\") pod \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\" (UID: \"91063e1f-ab78-46ee-8be9-3071c0ca2c6a\") "
Sep 16 14:21:19.123599 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.123421    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-util\") pod \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\" (UID: \"a79317b6-090d-4d2e-99bf-e4cd68b8d36a\") "
Sep 16 14:21:19.124036 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.124005    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-bundle" (OuterVolumeSpecName: "bundle") pod "91063e1f-ab78-46ee-8be9-3071c0ca2c6a" (UID: "91063e1f-ab78-46ee-8be9-3071c0ca2c6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:21:19.124132 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.124052    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-bundle" (OuterVolumeSpecName: "bundle") pod "a79317b6-090d-4d2e-99bf-e4cd68b8d36a" (UID: "a79317b6-090d-4d2e-99bf-e4cd68b8d36a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:21:19.126120 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.126094    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-kube-api-access-4dp7f" (OuterVolumeSpecName: "kube-api-access-4dp7f") pod "a79317b6-090d-4d2e-99bf-e4cd68b8d36a" (UID: "a79317b6-090d-4d2e-99bf-e4cd68b8d36a"). InnerVolumeSpecName "kube-api-access-4dp7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:21:19.126459 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.126435    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-kube-api-access-xjrgj" (OuterVolumeSpecName: "kube-api-access-xjrgj") pod "91063e1f-ab78-46ee-8be9-3071c0ca2c6a" (UID: "91063e1f-ab78-46ee-8be9-3071c0ca2c6a"). InnerVolumeSpecName "kube-api-access-xjrgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:21:19.130568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.130542    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-util" (OuterVolumeSpecName: "util") pod "a79317b6-090d-4d2e-99bf-e4cd68b8d36a" (UID: "a79317b6-090d-4d2e-99bf-e4cd68b8d36a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:21:19.131101 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.131075    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-util" (OuterVolumeSpecName: "util") pod "91063e1f-ab78-46ee-8be9-3071c0ca2c6a" (UID: "91063e1f-ab78-46ee-8be9-3071c0ca2c6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:21:19.224691 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.224666    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0949a152-ebb0-4889-9fcd-d6acc6c65a63-util\") pod \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\" (UID: \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\") "
Sep 16 14:21:19.224798 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.224709    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4774a995-14ba-4ede-b3bb-a66d92a31cb7-util\") pod \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\" (UID: \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\") "
Sep 16 14:21:19.224798 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.224738    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ttf9\" (UniqueName: \"kubernetes.io/projected/4774a995-14ba-4ede-b3bb-a66d92a31cb7-kube-api-access-6ttf9\") pod \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\" (UID: \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\") "
Sep 16 14:21:19.224907 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.224807    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4774a995-14ba-4ede-b3bb-a66d92a31cb7-bundle\") pod \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\" (UID: \"4774a995-14ba-4ede-b3bb-a66d92a31cb7\") "
Sep 16 14:21:19.224907 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.224831    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0949a152-ebb0-4889-9fcd-d6acc6c65a63-bundle\") pod \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\" (UID: \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\") "
Sep 16 14:21:19.224907 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.224876    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr8g7\" (UniqueName: \"kubernetes.io/projected/0949a152-ebb0-4889-9fcd-d6acc6c65a63-kube-api-access-vr8g7\") pod \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\" (UID: \"0949a152-ebb0-4889-9fcd-d6acc6c65a63\") "
Sep 16 14:21:19.225085 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.225068    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-util\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:19.225149 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.225091    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dp7f\" (UniqueName: \"kubernetes.io/projected/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-kube-api-access-4dp7f\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:19.225149 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.225106    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a79317b6-090d-4d2e-99bf-e4cd68b8d36a-bundle\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:19.225149 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.225121    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjrgj\" (UniqueName: \"kubernetes.io/projected/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-kube-api-access-xjrgj\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:19.225149 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.225134    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-bundle\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:19.225149 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.225146    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91063e1f-ab78-46ee-8be9-3071c0ca2c6a-util\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:19.225377 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.225357    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0949a152-ebb0-4889-9fcd-d6acc6c65a63-bundle" (OuterVolumeSpecName: "bundle") pod "0949a152-ebb0-4889-9fcd-d6acc6c65a63" (UID: "0949a152-ebb0-4889-9fcd-d6acc6c65a63"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:21:19.225377 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.225360    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4774a995-14ba-4ede-b3bb-a66d92a31cb7-bundle" (OuterVolumeSpecName: "bundle") pod "4774a995-14ba-4ede-b3bb-a66d92a31cb7" (UID: "4774a995-14ba-4ede-b3bb-a66d92a31cb7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:21:19.226880 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.226860    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0949a152-ebb0-4889-9fcd-d6acc6c65a63-kube-api-access-vr8g7" (OuterVolumeSpecName: "kube-api-access-vr8g7") pod "0949a152-ebb0-4889-9fcd-d6acc6c65a63" (UID: "0949a152-ebb0-4889-9fcd-d6acc6c65a63"). InnerVolumeSpecName "kube-api-access-vr8g7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:21:19.227116 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.227093    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4774a995-14ba-4ede-b3bb-a66d92a31cb7-kube-api-access-6ttf9" (OuterVolumeSpecName: "kube-api-access-6ttf9") pod "4774a995-14ba-4ede-b3bb-a66d92a31cb7" (UID: "4774a995-14ba-4ede-b3bb-a66d92a31cb7"). InnerVolumeSpecName "kube-api-access-6ttf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:21:19.230533 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.230504    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0949a152-ebb0-4889-9fcd-d6acc6c65a63-util" (OuterVolumeSpecName: "util") pod "0949a152-ebb0-4889-9fcd-d6acc6c65a63" (UID: "0949a152-ebb0-4889-9fcd-d6acc6c65a63"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:21:19.231013 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.230994    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4774a995-14ba-4ede-b3bb-a66d92a31cb7-util" (OuterVolumeSpecName: "util") pod "4774a995-14ba-4ede-b3bb-a66d92a31cb7" (UID: "4774a995-14ba-4ede-b3bb-a66d92a31cb7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:21:19.325669 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.325644    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4774a995-14ba-4ede-b3bb-a66d92a31cb7-bundle\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:19.325669 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.325665    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0949a152-ebb0-4889-9fcd-d6acc6c65a63-bundle\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:19.325791 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.325675    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr8g7\" (UniqueName: \"kubernetes.io/projected/0949a152-ebb0-4889-9fcd-d6acc6c65a63-kube-api-access-vr8g7\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:19.325791 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.325690    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0949a152-ebb0-4889-9fcd-d6acc6c65a63-util\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:19.325791 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.325701    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4774a995-14ba-4ede-b3bb-a66d92a31cb7-util\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:19.325791 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.325708    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ttf9\" (UniqueName: \"kubernetes.io/projected/4774a995-14ba-4ede-b3bb-a66d92a31cb7-kube-api-access-6ttf9\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:19.897379 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.897355    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww"
Sep 16 14:21:19.897543 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.897350    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68z7ww" event={"ID":"0949a152-ebb0-4889-9fcd-d6acc6c65a63","Type":"ContainerDied","Data":"b5593e4a8db6c03e83de554dbf0631c911a5af0a65be83315650b360fc4d524c"}
Sep 16 14:21:19.897543 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.897502    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5593e4a8db6c03e83de554dbf0631c911a5af0a65be83315650b360fc4d524c"
Sep 16 14:21:19.899286 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.899257    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh" event={"ID":"a79317b6-090d-4d2e-99bf-e4cd68b8d36a","Type":"ContainerDied","Data":"8bab8b9348e72a82229160256cc2c541fcac44ef44127fc2ca1fe3dd3fc4f392"}
Sep 16 14:21:19.899405 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.899297    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bab8b9348e72a82229160256cc2c541fcac44ef44127fc2ca1fe3dd3fc4f392"
Sep 16 14:21:19.899405 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.899266    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah7zqh"
Sep 16 14:21:19.901622 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.901603    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf"
Sep 16 14:21:19.901736 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.901603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cp9kqf" event={"ID":"4774a995-14ba-4ede-b3bb-a66d92a31cb7","Type":"ContainerDied","Data":"091a97ee92eb9e6d99ec2a1674d18354b37d68e31f42a4bd1fa49db891e08993"}
Sep 16 14:21:19.901736 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.901723    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="091a97ee92eb9e6d99ec2a1674d18354b37d68e31f42a4bd1fa49db891e08993"
Sep 16 14:21:19.903818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.903797    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn" event={"ID":"91063e1f-ab78-46ee-8be9-3071c0ca2c6a","Type":"ContainerDied","Data":"c7621ec36caba9ab04e0731ba118f384efffcfc2b8fbc35eed6c8e20fed5c15c"}
Sep 16 14:21:19.903931 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.903827    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7621ec36caba9ab04e0731ba118f384efffcfc2b8fbc35eed6c8e20fed5c15c"
Sep 16 14:21:19.903931 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:19.903827    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v7pnn"
Sep 16 14:21:22.132426 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:22.132393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:22.961491 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:22.961460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:23.741182 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:23.741148    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:25.790997 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:25.790965    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:25.925645 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:25.925607    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:26.828007 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.827977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:26.855245 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855214    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"]
Sep 16 14:21:26.855527 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855516    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79317b6-090d-4d2e-99bf-e4cd68b8d36a" containerName="extract"
Sep 16 14:21:26.855566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855530    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79317b6-090d-4d2e-99bf-e4cd68b8d36a" containerName="extract"
Sep 16 14:21:26.855566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855540    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0949a152-ebb0-4889-9fcd-d6acc6c65a63" containerName="pull"
Sep 16 14:21:26.855566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855546    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0949a152-ebb0-4889-9fcd-d6acc6c65a63" containerName="pull"
Sep 16 14:21:26.855566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855554    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79317b6-090d-4d2e-99bf-e4cd68b8d36a" containerName="util"
Sep 16 14:21:26.855566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855560    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79317b6-090d-4d2e-99bf-e4cd68b8d36a" containerName="util"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855568    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4774a995-14ba-4ede-b3bb-a66d92a31cb7" containerName="util"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855573    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4774a995-14ba-4ede-b3bb-a66d92a31cb7" containerName="util"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855581    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4774a995-14ba-4ede-b3bb-a66d92a31cb7" containerName="pull"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855585    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4774a995-14ba-4ede-b3bb-a66d92a31cb7" containerName="pull"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855594    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91063e1f-ab78-46ee-8be9-3071c0ca2c6a" containerName="extract"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855599    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="91063e1f-ab78-46ee-8be9-3071c0ca2c6a" containerName="extract"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855607    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0949a152-ebb0-4889-9fcd-d6acc6c65a63" containerName="util"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855612    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0949a152-ebb0-4889-9fcd-d6acc6c65a63" containerName="util"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855618    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91063e1f-ab78-46ee-8be9-3071c0ca2c6a" containerName="util"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855623    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="91063e1f-ab78-46ee-8be9-3071c0ca2c6a" containerName="util"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855629    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79317b6-090d-4d2e-99bf-e4cd68b8d36a" containerName="pull"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855633    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79317b6-090d-4d2e-99bf-e4cd68b8d36a" containerName="pull"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855638    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4774a995-14ba-4ede-b3bb-a66d92a31cb7" containerName="extract"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855642    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4774a995-14ba-4ede-b3bb-a66d92a31cb7" containerName="extract"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855649    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0949a152-ebb0-4889-9fcd-d6acc6c65a63" containerName="extract"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855654    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0949a152-ebb0-4889-9fcd-d6acc6c65a63" containerName="extract"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855662    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91063e1f-ab78-46ee-8be9-3071c0ca2c6a" containerName="pull"
Sep 16 14:21:26.855712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855666    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="91063e1f-ab78-46ee-8be9-3071c0ca2c6a" containerName="pull"
Sep 16 14:21:26.856393 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855741    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79317b6-090d-4d2e-99bf-e4cd68b8d36a" containerName="extract"
Sep 16 14:21:26.856393 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855750    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0949a152-ebb0-4889-9fcd-d6acc6c65a63" containerName="extract"
Sep 16 14:21:26.856393 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855755    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4774a995-14ba-4ede-b3bb-a66d92a31cb7" containerName="extract"
Sep 16 14:21:26.856393 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.855762    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="91063e1f-ab78-46ee-8be9-3071c0ca2c6a" containerName="extract"
Sep 16 14:21:26.860081 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.860064    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:26.868353 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.868318    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 14:21:26.868464 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.868419    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wt2h7\""
Sep 16 14:21:26.868524 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.868480    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 14:21:26.881939 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.881907    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"]
Sep 16 14:21:26.986699 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.986674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02736254-afa5-4dc0-9eaa-f43118aaede4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" (UID: \"02736254-afa5-4dc0-9eaa-f43118aaede4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:26.986848 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:26.986721    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9th6\" (UniqueName: \"kubernetes.io/projected/02736254-afa5-4dc0-9eaa-f43118aaede4-kube-api-access-v9th6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" (UID: \"02736254-afa5-4dc0-9eaa-f43118aaede4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:27.087858 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:27.087766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02736254-afa5-4dc0-9eaa-f43118aaede4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" (UID: \"02736254-afa5-4dc0-9eaa-f43118aaede4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:27.087980 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:27.087868    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9th6\" (UniqueName: \"kubernetes.io/projected/02736254-afa5-4dc0-9eaa-f43118aaede4-kube-api-access-v9th6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" (UID: \"02736254-afa5-4dc0-9eaa-f43118aaede4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:27.088140 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:27.088123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02736254-afa5-4dc0-9eaa-f43118aaede4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" (UID: \"02736254-afa5-4dc0-9eaa-f43118aaede4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:27.102708 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:27.102681    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9th6\" (UniqueName: \"kubernetes.io/projected/02736254-afa5-4dc0-9eaa-f43118aaede4-kube-api-access-v9th6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" (UID: \"02736254-afa5-4dc0-9eaa-f43118aaede4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:27.170694 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:27.170669    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:27.177063 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:27.177036    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:27.449001 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:27.448919    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:27.465283 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:27.465258    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"]
Sep 16 14:21:27.467289 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:21:27.467263    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02736254_afa5_4dc0_9eaa_f43118aaede4.slice/crio-886d9c9120183c395d4243d8bf62bd80b922abb229f9bfd7b24ff1a0ad172854 WatchSource:0}: Error finding container 886d9c9120183c395d4243d8bf62bd80b922abb229f9bfd7b24ff1a0ad172854: Status 404 returned error can't find the container with id 886d9c9120183c395d4243d8bf62bd80b922abb229f9bfd7b24ff1a0ad172854
Sep 16 14:21:27.552228 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:27.552187    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:27.943721 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:27.943680    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl" event={"ID":"02736254-afa5-4dc0-9eaa-f43118aaede4","Type":"ContainerStarted","Data":"886d9c9120183c395d4243d8bf62bd80b922abb229f9bfd7b24ff1a0ad172854"}
Sep 16 14:21:29.813988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:29.813910    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:31.620906 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:31.620864    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6"]
Sep 16 14:21:31.624548 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:31.624520    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6"
Sep 16 14:21:31.628077 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:31.628033    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 16 14:21:31.628219 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:31.628121    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-n797d\""
Sep 16 14:21:31.655425 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:31.655401    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6"]
Sep 16 14:21:31.723663 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:31.723632    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w58d4\" (UniqueName: \"kubernetes.io/projected/3ce616e4-90c4-4ad3-b89f-c71d9f0cc79f-kube-api-access-w58d4\") pod \"dns-operator-controller-manager-7b84cd7c9c-rlnj6\" (UID: \"3ce616e4-90c4-4ad3-b89f-c71d9f0cc79f\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6"
Sep 16 14:21:31.824902 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:31.824863    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w58d4\" (UniqueName: \"kubernetes.io/projected/3ce616e4-90c4-4ad3-b89f-c71d9f0cc79f-kube-api-access-w58d4\") pod \"dns-operator-controller-manager-7b84cd7c9c-rlnj6\" (UID: \"3ce616e4-90c4-4ad3-b89f-c71d9f0cc79f\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6"
Sep 16 14:21:31.842874 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:31.842849    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w58d4\" (UniqueName: \"kubernetes.io/projected/3ce616e4-90c4-4ad3-b89f-c71d9f0cc79f-kube-api-access-w58d4\") pod \"dns-operator-controller-manager-7b84cd7c9c-rlnj6\" (UID: \"3ce616e4-90c4-4ad3-b89f-c71d9f0cc79f\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6"
Sep 16 14:21:31.937945 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:31.937922    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6"
Sep 16 14:21:31.976147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:31.976117    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl" event={"ID":"02736254-afa5-4dc0-9eaa-f43118aaede4","Type":"ContainerStarted","Data":"35f5f2dde2e5fa3707bef0d03d86d223312dbd5c01a65b7b0b94a30ad1f79158"}
Sep 16 14:21:31.976330 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:31.976224    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:32.005248 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:32.005177    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl" podStartSLOduration=1.574695689 podStartE2EDuration="6.005151332s" totalImagesPullingTime="4.430455643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:21:32.003346331 +0000 UTC m=+411.297034811" watchObservedRunningTime="2026-09-16 14:21:32.005151332 +0000 UTC m=+411.298839811"
Sep 16 14:21:32.227977 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:32.222647    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6"]
Sep 16 14:21:32.409195 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:32.409152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:32.982486 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:32.982451    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6" event={"ID":"3ce616e4-90c4-4ad3-b89f-c71d9f0cc79f","Type":"ContainerStarted","Data":"f17dc07894af87134335d771f6d2a7178f4351874ddf594d98b8382b2ef03b75"}
Sep 16 14:21:33.011903 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:33.011867    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:34.404526 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:34.404419    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:34.995843 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:34.995801    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6" event={"ID":"3ce616e4-90c4-4ad3-b89f-c71d9f0cc79f","Type":"ContainerStarted","Data":"816ae2bbb6c2a616af1457bfea28b92972c21fa21f20385d4e861927806a6482"}
Sep 16 14:21:34.996052 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:34.995960    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6"
Sep 16 14:21:35.008398 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:35.008363    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"]
Sep 16 14:21:35.012016 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:35.011998    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:35.027652 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:35.027624    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"limitador-operator-controller-manager-dockercfg-wsxhp\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wsxhp\"" type="*v1.Secret"
Sep 16 14:21:35.070127 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:35.070098    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"]
Sep 16 14:21:35.070443 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:35.070401    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6" podStartSLOduration=2.195221527 podStartE2EDuration="4.070388067s" totalImagesPullingTime="1.87516654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:21:35.066820397 +0000 UTC m=+414.360508877" watchObservedRunningTime="2026-09-16 14:21:35.070388067 +0000 UTC m=+414.364076607"
Sep 16 14:21:35.155202 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:35.155171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snvw7\" (UniqueName: \"kubernetes.io/projected/6eac5e57-b599-403f-b33d-698d52de8506-kube-api-access-snvw7\") pod \"limitador-operator-controller-manager-74495c69f8-9xzlv\" (UID: \"6eac5e57-b599-403f-b33d-698d52de8506\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:35.256544 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:35.256470    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snvw7\" (UniqueName: \"kubernetes.io/projected/6eac5e57-b599-403f-b33d-698d52de8506-kube-api-access-snvw7\") pod \"limitador-operator-controller-manager-74495c69f8-9xzlv\" (UID: \"6eac5e57-b599-403f-b33d-698d52de8506\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:35.277921 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:35.277884    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snvw7\" (UniqueName: \"kubernetes.io/projected/6eac5e57-b599-403f-b33d-698d52de8506-kube-api-access-snvw7\") pod \"limitador-operator-controller-manager-74495c69f8-9xzlv\" (UID: \"6eac5e57-b599-403f-b33d-698d52de8506\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:35.455557 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:35.455528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:35.548352 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:35.548324    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:35.920979 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:35.920895    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wsxhp\""
Sep 16 14:21:35.921915 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:35.921899    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:36.207688 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:36.207663    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"]
Sep 16 14:21:36.209449 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:21:36.209413    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eac5e57_b599_403f_b33d_698d52de8506.slice/crio-d1ffe04be0a6b55220d9acb643e714a8bac2c5f952f9c24bc118df6e683e74fa WatchSource:0}: Error finding container d1ffe04be0a6b55220d9acb643e714a8bac2c5f952f9c24bc118df6e683e74fa: Status 404 returned error can't find the container with id d1ffe04be0a6b55220d9acb643e714a8bac2c5f952f9c24bc118df6e683e74fa
Sep 16 14:21:37.007835 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:37.007792    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv" event={"ID":"6eac5e57-b599-403f-b33d-698d52de8506","Type":"ContainerStarted","Data":"d1ffe04be0a6b55220d9acb643e714a8bac2c5f952f9c24bc118df6e683e74fa"}
Sep 16 14:21:38.014378 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:38.014340    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv" event={"ID":"6eac5e57-b599-403f-b33d-698d52de8506","Type":"ContainerStarted","Data":"f16f494adff76716f3819a3995bf5529de6e714c0a0e25d8223b2e82714f914d"}
Sep 16 14:21:38.014817 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:38.014454    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:38.039664 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:38.039614    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv" podStartSLOduration=2.727675896 podStartE2EDuration="4.039596948s" totalImagesPullingTime="1.311921052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:21:38.037346511 +0000 UTC m=+417.331034990" watchObservedRunningTime="2026-09-16 14:21:38.039596948 +0000 UTC m=+417.333285427"
Sep 16 14:21:38.550361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:38.550323    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:38.644731 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:38.644677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:38.730175 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:38.730147    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:38.799477 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:38.799448    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:39.723019 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:39.722986    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:39.788758 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:39.788721    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:42.984729 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:42.984694    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:45.376490 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.376455    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"]
Sep 16 14:21:45.376972 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.376683    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" containerName="manager" containerID="cri-o://35f5f2dde2e5fa3707bef0d03d86d223312dbd5c01a65b7b0b94a30ad1f79158" gracePeriod=2
Sep 16 14:21:45.390691 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.390659    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"]
Sep 16 14:21:45.393392 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:45.393352    2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"02736254-afa5-4dc0-9eaa-f43118aaede4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-d46jl\": pods \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:45.403394 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.403369    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"]
Sep 16 14:21:45.403725 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.403670    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" containerName="manager"
Sep 16 14:21:45.403725 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.403701    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" containerName="manager"
Sep 16 14:21:45.403906 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.403777    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" containerName="manager"
Sep 16 14:21:45.407252 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.406855    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"]
Sep 16 14:21:45.407252 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.407059    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv" podUID="6eac5e57-b599-403f-b33d-698d52de8506" containerName="manager" containerID="cri-o://f16f494adff76716f3819a3995bf5529de6e714c0a0e25d8223b2e82714f914d" gracePeriod=2
Sep 16 14:21:45.407412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.407287    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"
Sep 16 14:21:45.409927 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.409882    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:45.410280 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.410260    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"]
Sep 16 14:21:45.424262 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.424217    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"]
Sep 16 14:21:45.436367 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.436336    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd"]
Sep 16 14:21:45.436663 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.436646    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eac5e57-b599-403f-b33d-698d52de8506" containerName="manager"
Sep 16 14:21:45.436663 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.436664    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eac5e57-b599-403f-b33d-698d52de8506" containerName="manager"
Sep 16 14:21:45.436785 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.436726    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eac5e57-b599-403f-b33d-698d52de8506" containerName="manager"
Sep 16 14:21:45.439801 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.439784    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd"
Sep 16 14:21:45.448726 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:45.448688    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:45.452060 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:45.452033    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9xzlv\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="6eac5e57-b599-403f-b33d-698d52de8506" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:45.454335 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:45.454300    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:45.454434 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.454337    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd"]
Sep 16 14:21:45.456609 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:45.456578    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9xzlv\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="6eac5e57-b599-403f-b33d-698d52de8506" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:45.543732 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.543685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vccsp\" (UniqueName: \"kubernetes.io/projected/ccecbed5-6218-49f8-bc05-86f08b101154-kube-api-access-vccsp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mskld\" (UID: \"ccecbed5-6218-49f8-bc05-86f08b101154\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"
Sep 16 14:21:45.543889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.543765    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccecbed5-6218-49f8-bc05-86f08b101154-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mskld\" (UID: \"ccecbed5-6218-49f8-bc05-86f08b101154\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"
Sep 16 14:21:45.543889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.543819    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkwn9\" (UniqueName: \"kubernetes.io/projected/78983e1b-de12-4daa-98a4-db8620a8fbfa-kube-api-access-vkwn9\") pod \"limitador-operator-controller-manager-74495c69f8-zsrvd\" (UID: \"78983e1b-de12-4daa-98a4-db8620a8fbfa\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd"
Sep 16 14:21:45.644411 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.644387    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vccsp\" (UniqueName: \"kubernetes.io/projected/ccecbed5-6218-49f8-bc05-86f08b101154-kube-api-access-vccsp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mskld\" (UID: \"ccecbed5-6218-49f8-bc05-86f08b101154\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"
Sep 16 14:21:45.644507 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.644428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccecbed5-6218-49f8-bc05-86f08b101154-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mskld\" (UID: \"ccecbed5-6218-49f8-bc05-86f08b101154\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"
Sep 16 14:21:45.644507 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.644464    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwn9\" (UniqueName: \"kubernetes.io/projected/78983e1b-de12-4daa-98a4-db8620a8fbfa-kube-api-access-vkwn9\") pod \"limitador-operator-controller-manager-74495c69f8-zsrvd\" (UID: \"78983e1b-de12-4daa-98a4-db8620a8fbfa\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd"
Sep 16 14:21:45.644793 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.644768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccecbed5-6218-49f8-bc05-86f08b101154-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mskld\" (UID: \"ccecbed5-6218-49f8-bc05-86f08b101154\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"
Sep 16 14:21:45.646112 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.646092    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:45.648198 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:45.648172    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:45.648656 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.648640    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:45.650228 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:45.650208    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9xzlv\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="6eac5e57-b599-403f-b33d-698d52de8506" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:45.652185 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:45.652156    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:45.653494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.653476    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkwn9\" (UniqueName: \"kubernetes.io/projected/78983e1b-de12-4daa-98a4-db8620a8fbfa-kube-api-access-vkwn9\") pod \"limitador-operator-controller-manager-74495c69f8-zsrvd\" (UID: \"78983e1b-de12-4daa-98a4-db8620a8fbfa\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd"
Sep 16 14:21:45.653568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.653544    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vccsp\" (UniqueName: \"kubernetes.io/projected/ccecbed5-6218-49f8-bc05-86f08b101154-kube-api-access-vccsp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mskld\" (UID: \"ccecbed5-6218-49f8-bc05-86f08b101154\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"
Sep 16 14:21:45.654134 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:45.654103    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9xzlv\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="6eac5e57-b599-403f-b33d-698d52de8506" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:45.745498 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.745463    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02736254-afa5-4dc0-9eaa-f43118aaede4-extensions-socket-volume\") pod \"02736254-afa5-4dc0-9eaa-f43118aaede4\" (UID: \"02736254-afa5-4dc0-9eaa-f43118aaede4\") "
Sep 16 14:21:45.745672 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.745562    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snvw7\" (UniqueName: \"kubernetes.io/projected/6eac5e57-b599-403f-b33d-698d52de8506-kube-api-access-snvw7\") pod \"6eac5e57-b599-403f-b33d-698d52de8506\" (UID: \"6eac5e57-b599-403f-b33d-698d52de8506\") "
Sep 16 14:21:45.745672 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.745582    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9th6\" (UniqueName: \"kubernetes.io/projected/02736254-afa5-4dc0-9eaa-f43118aaede4-kube-api-access-v9th6\") pod \"02736254-afa5-4dc0-9eaa-f43118aaede4\" (UID: \"02736254-afa5-4dc0-9eaa-f43118aaede4\") "
Sep 16 14:21:45.745912 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.745886    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02736254-afa5-4dc0-9eaa-f43118aaede4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "02736254-afa5-4dc0-9eaa-f43118aaede4" (UID: "02736254-afa5-4dc0-9eaa-f43118aaede4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:21:45.747729 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.747705    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02736254-afa5-4dc0-9eaa-f43118aaede4-kube-api-access-v9th6" (OuterVolumeSpecName: "kube-api-access-v9th6") pod "02736254-afa5-4dc0-9eaa-f43118aaede4" (UID: "02736254-afa5-4dc0-9eaa-f43118aaede4"). InnerVolumeSpecName "kube-api-access-v9th6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:21:45.747729 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.747721    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eac5e57-b599-403f-b33d-698d52de8506-kube-api-access-snvw7" (OuterVolumeSpecName: "kube-api-access-snvw7") pod "6eac5e57-b599-403f-b33d-698d52de8506" (UID: "6eac5e57-b599-403f-b33d-698d52de8506"). InnerVolumeSpecName "kube-api-access-snvw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:21:45.832184 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.832150    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"
Sep 16 14:21:45.838792 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.838774    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd"
Sep 16 14:21:45.846852 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.846827    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02736254-afa5-4dc0-9eaa-f43118aaede4-extensions-socket-volume\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:45.846937 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.846859    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snvw7\" (UniqueName: \"kubernetes.io/projected/6eac5e57-b599-403f-b33d-698d52de8506-kube-api-access-snvw7\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:45.846937 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:45.846875    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9th6\" (UniqueName: \"kubernetes.io/projected/02736254-afa5-4dc0-9eaa-f43118aaede4-kube-api-access-v9th6\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:21:46.003120 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.003082    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlnj6"
Sep 16 14:21:46.005531 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:46.005508    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:46.007585 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:46.007561    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9xzlv\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="6eac5e57-b599-403f-b33d-698d52de8506" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:46.055726 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.055688    2582 generic.go:356] "Generic (PLEG): container finished" podID="02736254-afa5-4dc0-9eaa-f43118aaede4" containerID="35f5f2dde2e5fa3707bef0d03d86d223312dbd5c01a65b7b0b94a30ad1f79158" exitCode=0
Sep 16 14:21:46.055910 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.055731    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:46.055910 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.055788    2582 scope.go:117] "RemoveContainer" containerID="35f5f2dde2e5fa3707bef0d03d86d223312dbd5c01a65b7b0b94a30ad1f79158"
Sep 16 14:21:46.057610 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.057578    2582 generic.go:356] "Generic (PLEG): container finished" podID="6eac5e57-b599-403f-b33d-698d52de8506" containerID="f16f494adff76716f3819a3995bf5529de6e714c0a0e25d8223b2e82714f914d" exitCode=0
Sep 16 14:21:46.057723 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.057625    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:46.058215 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:46.058183    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:46.060340 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:46.060309    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9xzlv\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="6eac5e57-b599-403f-b33d-698d52de8506" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:46.062142 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:46.062118    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:46.063836 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:46.063817    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9xzlv\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="6eac5e57-b599-403f-b33d-698d52de8506" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:46.066583 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.066561    2582 scope.go:117] "RemoveContainer" containerID="35f5f2dde2e5fa3707bef0d03d86d223312dbd5c01a65b7b0b94a30ad1f79158"
Sep 16 14:21:46.067165 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:46.066885    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f5f2dde2e5fa3707bef0d03d86d223312dbd5c01a65b7b0b94a30ad1f79158\": container with ID starting with 35f5f2dde2e5fa3707bef0d03d86d223312dbd5c01a65b7b0b94a30ad1f79158 not found: ID does not exist" containerID="35f5f2dde2e5fa3707bef0d03d86d223312dbd5c01a65b7b0b94a30ad1f79158"
Sep 16 14:21:46.067165 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.066919    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f5f2dde2e5fa3707bef0d03d86d223312dbd5c01a65b7b0b94a30ad1f79158"} err="failed to get container status \"35f5f2dde2e5fa3707bef0d03d86d223312dbd5c01a65b7b0b94a30ad1f79158\": rpc error: code = NotFound desc = could not find container \"35f5f2dde2e5fa3707bef0d03d86d223312dbd5c01a65b7b0b94a30ad1f79158\": container with ID starting with 35f5f2dde2e5fa3707bef0d03d86d223312dbd5c01a65b7b0b94a30ad1f79158 not found: ID does not exist"
Sep 16 14:21:46.067165 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.066943    2582 scope.go:117] "RemoveContainer" containerID="f16f494adff76716f3819a3995bf5529de6e714c0a0e25d8223b2e82714f914d"
Sep 16 14:21:46.070030 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:46.069999    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:46.072029 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:46.072005    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9xzlv\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="6eac5e57-b599-403f-b33d-698d52de8506" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:46.073822 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:46.073802    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:46.075703 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:46.075676    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9xzlv\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="6eac5e57-b599-403f-b33d-698d52de8506" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:46.076641 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.076620    2582 scope.go:117] "RemoveContainer" containerID="f16f494adff76716f3819a3995bf5529de6e714c0a0e25d8223b2e82714f914d"
Sep 16 14:21:46.076903 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:46.076887    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f16f494adff76716f3819a3995bf5529de6e714c0a0e25d8223b2e82714f914d\": container with ID starting with f16f494adff76716f3819a3995bf5529de6e714c0a0e25d8223b2e82714f914d not found: ID does not exist" containerID="f16f494adff76716f3819a3995bf5529de6e714c0a0e25d8223b2e82714f914d"
Sep 16 14:21:46.076946 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.076909    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f16f494adff76716f3819a3995bf5529de6e714c0a0e25d8223b2e82714f914d"} err="failed to get container status \"f16f494adff76716f3819a3995bf5529de6e714c0a0e25d8223b2e82714f914d\": rpc error: code = NotFound desc = could not find container \"f16f494adff76716f3819a3995bf5529de6e714c0a0e25d8223b2e82714f914d\": container with ID starting with f16f494adff76716f3819a3995bf5529de6e714c0a0e25d8223b2e82714f914d not found: ID does not exist"
Sep 16 14:21:46.111991 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.110463    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"]
Sep 16 14:21:46.116089 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:21:46.116062    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccecbed5_6218_49f8_bc05_86f08b101154.slice/crio-516f258aab1a2fc69077b94f0b95d24742dc0b11c34dd8a8261ef9f91cadc5ad WatchSource:0}: Error finding container 516f258aab1a2fc69077b94f0b95d24742dc0b11c34dd8a8261ef9f91cadc5ad: Status 404 returned error can't find the container with id 516f258aab1a2fc69077b94f0b95d24742dc0b11c34dd8a8261ef9f91cadc5ad
Sep 16 14:21:46.117821 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:46.117797    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd"]
Sep 16 14:21:46.119678 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:21:46.119655    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78983e1b_de12_4daa_98a4_db8620a8fbfa.slice/crio-281522ea2beb20207be238755f73578ba4031dd3a4cea411698127f32ef1ab87 WatchSource:0}: Error finding container 281522ea2beb20207be238755f73578ba4031dd3a4cea411698127f32ef1ab87: Status 404 returned error can't find the container with id 281522ea2beb20207be238755f73578ba4031dd3a4cea411698127f32ef1ab87
Sep 16 14:21:47.065586 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:47.065550    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd" event={"ID":"78983e1b-de12-4daa-98a4-db8620a8fbfa","Type":"ContainerStarted","Data":"127813ba0b1695b860f3871d0c7b70a6da559ff7e1fb03a2993638131327eb37"}
Sep 16 14:21:47.066055 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:47.065626    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd" event={"ID":"78983e1b-de12-4daa-98a4-db8620a8fbfa","Type":"ContainerStarted","Data":"281522ea2beb20207be238755f73578ba4031dd3a4cea411698127f32ef1ab87"}
Sep 16 14:21:47.066055 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:47.065676    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd"
Sep 16 14:21:47.067483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:47.067459    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld" event={"ID":"ccecbed5-6218-49f8-bc05-86f08b101154","Type":"ContainerStarted","Data":"76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f"}
Sep 16 14:21:47.067624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:47.067502    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld" event={"ID":"ccecbed5-6218-49f8-bc05-86f08b101154","Type":"ContainerStarted","Data":"516f258aab1a2fc69077b94f0b95d24742dc0b11c34dd8a8261ef9f91cadc5ad"}
Sep 16 14:21:47.067624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:47.067525    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"
Sep 16 14:21:47.101065 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:47.101015    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd" podStartSLOduration=2.100998416 podStartE2EDuration="2.100998416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:21:47.099172272 +0000 UTC m=+426.392860751" watchObservedRunningTime="2026-09-16 14:21:47.100998416 +0000 UTC m=+426.394686896"
Sep 16 14:21:47.105790 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:47.105759    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:47.109393 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:47.109372    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9xzlv\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="6eac5e57-b599-403f-b33d-698d52de8506" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:47.112262 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:47.112226    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-d46jl\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d46jl"
Sep 16 14:21:47.114321 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:21:47.114300    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9xzlv\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="6eac5e57-b599-403f-b33d-698d52de8506" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9xzlv"
Sep 16 14:21:47.150763 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:47.150723    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld" podStartSLOduration=2.150710224 podStartE2EDuration="2.150710224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:21:47.149373739 +0000 UTC m=+426.443062230" watchObservedRunningTime="2026-09-16 14:21:47.150710224 +0000 UTC m=+426.444398702"
Sep 16 14:21:47.179984 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:47.179958    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02736254-afa5-4dc0-9eaa-f43118aaede4" path="/var/lib/kubelet/pods/02736254-afa5-4dc0-9eaa-f43118aaede4/volumes"
Sep 16 14:21:47.180294 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:47.180280    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eac5e57-b599-403f-b33d-698d52de8506" path="/var/lib/kubelet/pods/6eac5e57-b599-403f-b33d-698d52de8506/volumes"
Sep 16 14:21:47.762776 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:47.762743    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:47.866901 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:47.866856    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:50.202807 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:50.202732    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:50.303889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:50.303856    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:52.573028 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:52.572991    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:54.927198 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:54.927150    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:55.028047 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:55.028014    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:21:58.076495 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:58.076464    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"
Sep 16 14:21:58.076895 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:21:58.076539    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zsrvd"
Sep 16 14:22:00.139223 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:00.139189    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:00.212079 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:00.212045    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:00.541246 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:00.541207    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:00.616950 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:00.616917    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:00.748325 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:00.748292    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:00.846992 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:00.846909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:02.058676 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:02.058641    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"]
Sep 16 14:22:02.059019 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:02.058862    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld" podUID="ccecbed5-6218-49f8-bc05-86f08b101154" containerName="manager" containerID="cri-o://76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f" gracePeriod=10
Sep 16 14:22:02.308844 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:02.308786    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"
Sep 16 14:22:02.371283 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:02.371246    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccecbed5-6218-49f8-bc05-86f08b101154-extensions-socket-volume\") pod \"ccecbed5-6218-49f8-bc05-86f08b101154\" (UID: \"ccecbed5-6218-49f8-bc05-86f08b101154\") "
Sep 16 14:22:02.371429 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:02.371287    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vccsp\" (UniqueName: \"kubernetes.io/projected/ccecbed5-6218-49f8-bc05-86f08b101154-kube-api-access-vccsp\") pod \"ccecbed5-6218-49f8-bc05-86f08b101154\" (UID: \"ccecbed5-6218-49f8-bc05-86f08b101154\") "
Sep 16 14:22:02.371638 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:02.371619    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccecbed5-6218-49f8-bc05-86f08b101154-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ccecbed5-6218-49f8-bc05-86f08b101154" (UID: "ccecbed5-6218-49f8-bc05-86f08b101154"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:22:02.373284 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:02.373265    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccecbed5-6218-49f8-bc05-86f08b101154-kube-api-access-vccsp" (OuterVolumeSpecName: "kube-api-access-vccsp") pod "ccecbed5-6218-49f8-bc05-86f08b101154" (UID: "ccecbed5-6218-49f8-bc05-86f08b101154"). InnerVolumeSpecName "kube-api-access-vccsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:22:02.471842 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:02.471810    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vccsp\" (UniqueName: \"kubernetes.io/projected/ccecbed5-6218-49f8-bc05-86f08b101154-kube-api-access-vccsp\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:22:02.471842 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:02.471836    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccecbed5-6218-49f8-bc05-86f08b101154-extensions-socket-volume\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:22:03.157386 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:03.157348    2582 generic.go:356] "Generic (PLEG): container finished" podID="ccecbed5-6218-49f8-bc05-86f08b101154" containerID="76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f" exitCode=0
Sep 16 14:22:03.157386 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:03.157391    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"
Sep 16 14:22:03.157933 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:03.157430    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld" event={"ID":"ccecbed5-6218-49f8-bc05-86f08b101154","Type":"ContainerDied","Data":"76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f"}
Sep 16 14:22:03.157933 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:03.157484    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld" event={"ID":"ccecbed5-6218-49f8-bc05-86f08b101154","Type":"ContainerDied","Data":"516f258aab1a2fc69077b94f0b95d24742dc0b11c34dd8a8261ef9f91cadc5ad"}
Sep 16 14:22:03.157933 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:03.157510    2582 scope.go:117] "RemoveContainer" containerID="76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f"
Sep 16 14:22:03.166176 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:03.166160    2582 scope.go:117] "RemoveContainer" containerID="76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f"
Sep 16 14:22:03.166441 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:22:03.166423    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f\": container with ID starting with 76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f not found: ID does not exist" containerID="76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f"
Sep 16 14:22:03.166485 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:03.166448    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f"} err="failed to get container status \"76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f\": rpc error: code = NotFound desc = could not find container \"76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f\": container with ID starting with 76b8b9dedc82d80bac79589d0df3fa37c172c076f09e02c0887c97a8a4a6e66f not found: ID does not exist"
Sep 16 14:22:03.188198 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:03.188174    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"]
Sep 16 14:22:03.201415 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:03.201392    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mskld"]
Sep 16 14:22:05.179499 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:05.179425    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccecbed5-6218-49f8-bc05-86f08b101154" path="/var/lib/kubelet/pods/ccecbed5-6218-49f8-bc05-86f08b101154/volumes"
Sep 16 14:22:09.749257 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:09.749202    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:09.850819 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:09.850787    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:12.011597 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:12.011561    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:12.089010 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:12.088959    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:16.753389 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:16.753351    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:16.854585 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:16.854545    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:18.465725 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.465687    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"]
Sep 16 14:22:18.466190 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.466157    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccecbed5-6218-49f8-bc05-86f08b101154" containerName="manager"
Sep 16 14:22:18.466190 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.466175    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccecbed5-6218-49f8-bc05-86f08b101154" containerName="manager"
Sep 16 14:22:18.466343 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.466297    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccecbed5-6218-49f8-bc05-86f08b101154" containerName="manager"
Sep 16 14:22:18.470078 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.470055    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.472902 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.472884    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-64x6w\""
Sep 16 14:22:18.489473 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.489446    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"]
Sep 16 14:22:18.597624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.597579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.597813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.597632    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.597813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.597665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2871ba-e815-4278-85f3-2e4aa481d93f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.597813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.597702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.597813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.597729    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q6w8\" (UniqueName: \"kubernetes.io/projected/cd2871ba-e815-4278-85f3-2e4aa481d93f-kube-api-access-6q6w8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.597813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.597747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2871ba-e815-4278-85f3-2e4aa481d93f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.597813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.597764    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.597813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.597782    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.598086 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.597850    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2871ba-e815-4278-85f3-2e4aa481d93f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.698422 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.698385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.698422 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.698425    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q6w8\" (UniqueName: \"kubernetes.io/projected/cd2871ba-e815-4278-85f3-2e4aa481d93f-kube-api-access-6q6w8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.698637 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.698446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2871ba-e815-4278-85f3-2e4aa481d93f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.698637 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.698466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.698637 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.698590    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.698637 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.698628    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2871ba-e815-4278-85f3-2e4aa481d93f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.698806 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.698685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.698806 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.698743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.698934 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.698909    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.698990 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.698941    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.698990 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.698939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2871ba-e815-4278-85f3-2e4aa481d93f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.699111 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.699097    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.699150 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.699109    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.699412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.699392    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd2871ba-e815-4278-85f3-2e4aa481d93f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.700967 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.700947    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd2871ba-e815-4278-85f3-2e4aa481d93f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.701343 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.701325    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd2871ba-e815-4278-85f3-2e4aa481d93f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.707258 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.707215    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd2871ba-e815-4278-85f3-2e4aa481d93f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.707615 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.707589    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q6w8\" (UniqueName: \"kubernetes.io/projected/cd2871ba-e815-4278-85f3-2e4aa481d93f-kube-api-access-6q6w8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cj4jw\" (UID: \"cd2871ba-e815-4278-85f3-2e4aa481d93f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.780151 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.780061    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:18.979041 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:18.978999    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:19.046007 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:19.045982    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:19.057411 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:19.057381    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"]
Sep 16 14:22:19.060559 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:22:19.060535    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd2871ba_e815_4278_85f3_2e4aa481d93f.slice/crio-dcd370d0b5c690ee38db10e1c0669a1fbcba32f55d6514acabd8d1edb242d8e9 WatchSource:0}: Error finding container dcd370d0b5c690ee38db10e1c0669a1fbcba32f55d6514acabd8d1edb242d8e9: Status 404 returned error can't find the container with id dcd370d0b5c690ee38db10e1c0669a1fbcba32f55d6514acabd8d1edb242d8e9
Sep 16 14:22:19.062989 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:19.062959    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:22:19.063058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:19.063023    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:22:19.063058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:19.063052    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:22:19.241409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:19.241371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw" event={"ID":"cd2871ba-e815-4278-85f3-2e4aa481d93f","Type":"ContainerStarted","Data":"57dce2be41216e2a31304e952703293116d465fe713f4be8c02cfedf9adcff89"}
Sep 16 14:22:19.241578 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:19.241431    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw" event={"ID":"cd2871ba-e815-4278-85f3-2e4aa481d93f","Type":"ContainerStarted","Data":"dcd370d0b5c690ee38db10e1c0669a1fbcba32f55d6514acabd8d1edb242d8e9"}
Sep 16 14:22:19.266347 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:19.266290    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw" podStartSLOduration=1.266273123 podStartE2EDuration="1.266273123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:22:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:22:19.263437842 +0000 UTC m=+458.557126323" watchObservedRunningTime="2026-09-16 14:22:19.266273123 +0000 UTC m=+458.559961602"
Sep 16 14:22:19.780803 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:19.780766    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:20.292394 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.292359    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:20.306495 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.306465    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-d4wrk"]
Sep 16 14:22:20.309758 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.309742    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-d4wrk"
Sep 16 14:22:20.312394 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.312371    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2f64c\""
Sep 16 14:22:20.312394 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.312373    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 16 14:22:20.319590 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.319565    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-d4wrk"]
Sep 16 14:22:20.402412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.402381    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-d4wrk"]
Sep 16 14:22:20.413129 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.413090    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:20.415382 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.415355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqxpn\" (UniqueName: \"kubernetes.io/projected/3cdef640-11cb-4b08-a3b4-772726fc59b5-kube-api-access-pqxpn\") pod \"limitador-limitador-8588749977-d4wrk\" (UID: \"3cdef640-11cb-4b08-a3b4-772726fc59b5\") " pod="kuadrant-system/limitador-limitador-8588749977-d4wrk"
Sep 16 14:22:20.415502 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.415409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3cdef640-11cb-4b08-a3b4-772726fc59b5-config-file\") pod \"limitador-limitador-8588749977-d4wrk\" (UID: \"3cdef640-11cb-4b08-a3b4-772726fc59b5\") " pod="kuadrant-system/limitador-limitador-8588749977-d4wrk"
Sep 16 14:22:20.513592 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.513556    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:20.516675 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.516655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqxpn\" (UniqueName: \"kubernetes.io/projected/3cdef640-11cb-4b08-a3b4-772726fc59b5-kube-api-access-pqxpn\") pod \"limitador-limitador-8588749977-d4wrk\" (UID: \"3cdef640-11cb-4b08-a3b4-772726fc59b5\") " pod="kuadrant-system/limitador-limitador-8588749977-d4wrk"
Sep 16 14:22:20.516746 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.516689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3cdef640-11cb-4b08-a3b4-772726fc59b5-config-file\") pod \"limitador-limitador-8588749977-d4wrk\" (UID: \"3cdef640-11cb-4b08-a3b4-772726fc59b5\") " pod="kuadrant-system/limitador-limitador-8588749977-d4wrk"
Sep 16 14:22:20.517274 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.517229    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3cdef640-11cb-4b08-a3b4-772726fc59b5-config-file\") pod \"limitador-limitador-8588749977-d4wrk\" (UID: \"3cdef640-11cb-4b08-a3b4-772726fc59b5\") " pod="kuadrant-system/limitador-limitador-8588749977-d4wrk"
Sep 16 14:22:20.526929 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.526900    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqxpn\" (UniqueName: \"kubernetes.io/projected/3cdef640-11cb-4b08-a3b4-772726fc59b5-kube-api-access-pqxpn\") pod \"limitador-limitador-8588749977-d4wrk\" (UID: \"3cdef640-11cb-4b08-a3b4-772726fc59b5\") " pod="kuadrant-system/limitador-limitador-8588749977-d4wrk"
Sep 16 14:22:20.622280 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.622172    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-d4wrk"
Sep 16 14:22:20.785621 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.785592    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:20.855474 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.855435    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:22:20.860035 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.860011    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"
Sep 16 14:22:20.869526 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.869501    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:22:20.896041 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.896020    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-d4wrk"]
Sep 16 14:22:20.897864 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:22:20.897842    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdef640_11cb_4b08_a3b4_772726fc59b5.slice/crio-bb0e6f0fcc9b6d62db790d9b38aa386c363fdc0eb68e605acc140f6636315501 WatchSource:0}: Error finding container bb0e6f0fcc9b6d62db790d9b38aa386c363fdc0eb68e605acc140f6636315501: Status 404 returned error can't find the container with id bb0e6f0fcc9b6d62db790d9b38aa386c363fdc0eb68e605acc140f6636315501
Sep 16 14:22:20.905676 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.905654    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:22:20.920226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.920204    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa-config-file\") pod \"limitador-limitador-84994f7ffc-4tg7m\" (UID: \"3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"
Sep 16 14:22:20.920342 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:20.920294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfkmx\" (UniqueName: \"kubernetes.io/projected/3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa-kube-api-access-wfkmx\") pod \"limitador-limitador-84994f7ffc-4tg7m\" (UID: \"3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"
Sep 16 14:22:21.021438 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:21.021405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa-config-file\") pod \"limitador-limitador-84994f7ffc-4tg7m\" (UID: \"3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"
Sep 16 14:22:21.021438 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:21.021444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfkmx\" (UniqueName: \"kubernetes.io/projected/3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa-kube-api-access-wfkmx\") pod \"limitador-limitador-84994f7ffc-4tg7m\" (UID: \"3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"
Sep 16 14:22:21.022009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:21.021987    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa-config-file\") pod \"limitador-limitador-84994f7ffc-4tg7m\" (UID: \"3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"
Sep 16 14:22:21.040137 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:21.040114    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfkmx\" (UniqueName: \"kubernetes.io/projected/3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa-kube-api-access-wfkmx\") pod \"limitador-limitador-84994f7ffc-4tg7m\" (UID: \"3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"
Sep 16 14:22:21.170725 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:21.170640    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"
Sep 16 14:22:21.253713 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:21.253681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-d4wrk" event={"ID":"3cdef640-11cb-4b08-a3b4-772726fc59b5","Type":"ContainerStarted","Data":"bb0e6f0fcc9b6d62db790d9b38aa386c363fdc0eb68e605acc140f6636315501"}
Sep 16 14:22:21.254051 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:21.254034    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:21.255080 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:21.255060    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:22:21.264888 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:21.264868    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:21.368130 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:21.368100    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:21.452133 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:21.448948    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:22:22.260887 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:22.260846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m" event={"ID":"3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa","Type":"ContainerStarted","Data":"87f1153449ccc5cb45fe0c1d8ecbf7638587c9afe3ef30d246a7f246db706041"}
Sep 16 14:22:23.268057 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:23.268020    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m" event={"ID":"3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa","Type":"ContainerStarted","Data":"146927e244c982704cbee7d3def48938e3799ea90ffb66cbd3085eefe42e0748"}
Sep 16 14:22:23.285951 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:23.285894    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m" podStartSLOduration=2.335159917 podStartE2EDuration="3.285875061s" totalImagesPullingTime="950.715144ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:22:23.285365358 +0000 UTC m=+462.579053839" watchObservedRunningTime="2026-09-16 14:22:23.285875061 +0000 UTC m=+462.579563543"
Sep 16 14:22:24.273945 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:24.273916    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"
Sep 16 14:22:32.399185 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:32.399145    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:34.324186 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:34.324156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-d4wrk" event={"ID":"3cdef640-11cb-4b08-a3b4-772726fc59b5","Type":"ContainerStarted","Data":"21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a"}
Sep 16 14:22:34.324567 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:34.324290    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-d4wrk"
Sep 16 14:22:34.345424 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:34.345383    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-d4wrk" podStartSLOduration=1.303777354 podStartE2EDuration="14.345370703s" totalImagesPullingTime="13.041593349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:22:34.343763092 +0000 UTC m=+473.637451570" watchObservedRunningTime="2026-09-16 14:22:34.345370703 +0000 UTC m=+473.639059181"
Sep 16 14:22:35.279266 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:35.279207    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"
Sep 16 14:22:35.341878 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:35.341842    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-d4wrk"]
Sep 16 14:22:36.334681 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:36.334637    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-d4wrk" podUID="3cdef640-11cb-4b08-a3b4-772726fc59b5" containerName="limitador" containerID="cri-o://21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a" gracePeriod=30
Sep 16 14:22:37.274541 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.274517    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-d4wrk"
Sep 16 14:22:37.340992 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.340959    2582 generic.go:356] "Generic (PLEG): container finished" podID="3cdef640-11cb-4b08-a3b4-772726fc59b5" containerID="21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a" exitCode=0
Sep 16 14:22:37.341142 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.341008    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-d4wrk"
Sep 16 14:22:37.341142 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.341045    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-d4wrk" event={"ID":"3cdef640-11cb-4b08-a3b4-772726fc59b5","Type":"ContainerDied","Data":"21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a"}
Sep 16 14:22:37.341142 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.341092    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-d4wrk" event={"ID":"3cdef640-11cb-4b08-a3b4-772726fc59b5","Type":"ContainerDied","Data":"bb0e6f0fcc9b6d62db790d9b38aa386c363fdc0eb68e605acc140f6636315501"}
Sep 16 14:22:37.341142 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.341115    2582 scope.go:117] "RemoveContainer" containerID="21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a"
Sep 16 14:22:37.349564 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.349548    2582 scope.go:117] "RemoveContainer" containerID="21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a"
Sep 16 14:22:37.349826 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:22:37.349810    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a\": container with ID starting with 21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a not found: ID does not exist" containerID="21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a"
Sep 16 14:22:37.349872 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.349835    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a"} err="failed to get container status \"21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a\": rpc error: code = NotFound desc = could not find container \"21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a\": container with ID starting with 21faecf3d681323f42807d4a1f32c1fecf0dd0b4f55ffa4fcbad70fc4ab5c93a not found: ID does not exist"
Sep 16 14:22:37.355094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.355078    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqxpn\" (UniqueName: \"kubernetes.io/projected/3cdef640-11cb-4b08-a3b4-772726fc59b5-kube-api-access-pqxpn\") pod \"3cdef640-11cb-4b08-a3b4-772726fc59b5\" (UID: \"3cdef640-11cb-4b08-a3b4-772726fc59b5\") "
Sep 16 14:22:37.355155 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.355131    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3cdef640-11cb-4b08-a3b4-772726fc59b5-config-file\") pod \"3cdef640-11cb-4b08-a3b4-772726fc59b5\" (UID: \"3cdef640-11cb-4b08-a3b4-772726fc59b5\") "
Sep 16 14:22:37.355459 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.355437    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdef640-11cb-4b08-a3b4-772726fc59b5-config-file" (OuterVolumeSpecName: "config-file") pod "3cdef640-11cb-4b08-a3b4-772726fc59b5" (UID: "3cdef640-11cb-4b08-a3b4-772726fc59b5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:22:37.357030 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.357010    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cdef640-11cb-4b08-a3b4-772726fc59b5-kube-api-access-pqxpn" (OuterVolumeSpecName: "kube-api-access-pqxpn") pod "3cdef640-11cb-4b08-a3b4-772726fc59b5" (UID: "3cdef640-11cb-4b08-a3b4-772726fc59b5"). InnerVolumeSpecName "kube-api-access-pqxpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:22:37.456398 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.456337    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3cdef640-11cb-4b08-a3b4-772726fc59b5-config-file\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:22:37.456398 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.456361    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqxpn\" (UniqueName: \"kubernetes.io/projected/3cdef640-11cb-4b08-a3b4-772726fc59b5-kube-api-access-pqxpn\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:22:37.668539 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.668511    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-d4wrk"]
Sep 16 14:22:37.674407 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:37.674382    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-d4wrk"]
Sep 16 14:22:39.179441 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:39.179409    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cdef640-11cb-4b08-a3b4-772726fc59b5" path="/var/lib/kubelet/pods/3cdef640-11cb-4b08-a3b4-772726fc59b5/volumes"
Sep 16 14:22:41.573737 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:41.573708    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:41.957791 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:41.957708    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:42.067414 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:42.067380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:54.642338 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:54.642303    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:22:54.968994 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:22:54.968909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:02.527381 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.527339    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:02.580803 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.580768    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9f8647b69-mftxp"]
Sep 16 14:23:02.581330 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.581300    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdef640-11cb-4b08-a3b4-772726fc59b5" containerName="limitador"
Sep 16 14:23:02.581330 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.581329    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdef640-11cb-4b08-a3b4-772726fc59b5" containerName="limitador"
Sep 16 14:23:02.581544 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.581426    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdef640-11cb-4b08-a3b4-772726fc59b5" containerName="limitador"
Sep 16 14:23:02.586077 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.586053    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:02.597989 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.597970    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 14:23:02.598140 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.598120    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s8vl9\""
Sep 16 14:23:02.599106 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.599083    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 14:23:02.599207 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.599087    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 14:23:02.602205 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.602181    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9f8647b69-mftxp"]
Sep 16 14:23:02.668231 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.668183    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:02.742787 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.742764    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-webhook-cert\") pod \"maas-controller-9f8647b69-mftxp\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") " pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:02.742917 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.742816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q95jw\" (UniqueName: \"kubernetes.io/projected/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-kube-api-access-q95jw\") pod \"maas-controller-9f8647b69-mftxp\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") " pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:02.742917 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.742883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-metrics-certs\") pod \"maas-controller-9f8647b69-mftxp\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") " pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:02.770027 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.769998    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:02.843863 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.843833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-webhook-cert\") pod \"maas-controller-9f8647b69-mftxp\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") " pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:02.843993 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.843878    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q95jw\" (UniqueName: \"kubernetes.io/projected/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-kube-api-access-q95jw\") pod \"maas-controller-9f8647b69-mftxp\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") " pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:02.843993 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.843902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-metrics-certs\") pod \"maas-controller-9f8647b69-mftxp\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") " pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:02.844108 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:23:02.843989    2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 16 14:23:02.844108 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:23:02.844065    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-webhook-cert podName:8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc nodeName:}" failed. No retries permitted until 2026-09-16 14:23:03.344043856 +0000 UTC m=+502.637732328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-webhook-cert") pod "maas-controller-9f8647b69-mftxp" (UID: "8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc") : secret "maas-controller-webhook-cert" not found
Sep 16 14:23:02.846214 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.846194    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-metrics-certs\") pod \"maas-controller-9f8647b69-mftxp\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") " pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:02.854224 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.854205    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q95jw\" (UniqueName: \"kubernetes.io/projected/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-kube-api-access-q95jw\") pod \"maas-controller-9f8647b69-mftxp\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") " pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:02.867432 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.867411    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:02.975366 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:02.975340    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:03.348414 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:03.348385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-webhook-cert\") pod \"maas-controller-9f8647b69-mftxp\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") " pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:03.350649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:03.350622    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-webhook-cert\") pod \"maas-controller-9f8647b69-mftxp\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") " pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:03.497210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:03.497178    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:03.778134 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:03.778107    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9f8647b69-mftxp"]
Sep 16 14:23:03.779711 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:23:03.779673    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee1969f_3e23_4dfc_bf12_912ec3a5c3dc.slice/crio-4abe6e72d672b401b3076b91686ef8e7e1672c4dc9ac56b8047924c379cddead WatchSource:0}: Error finding container 4abe6e72d672b401b3076b91686ef8e7e1672c4dc9ac56b8047924c379cddead: Status 404 returned error can't find the container with id 4abe6e72d672b401b3076b91686ef8e7e1672c4dc9ac56b8047924c379cddead
Sep 16 14:23:04.482514 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:04.482437    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f8647b69-mftxp" event={"ID":"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc","Type":"ContainerStarted","Data":"4abe6e72d672b401b3076b91686ef8e7e1672c4dc9ac56b8047924c379cddead"}
Sep 16 14:23:06.099719 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:06.099689    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:06.209762 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:06.209721    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:06.494702 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:06.494666    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f8647b69-mftxp" event={"ID":"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc","Type":"ContainerStarted","Data":"99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520"}
Sep 16 14:23:06.494863 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:06.494729    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:06.516973 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:06.516919    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9f8647b69-mftxp" podStartSLOduration=2.269099013 podStartE2EDuration="4.516902605s" totalImagesPullingTime="2.247803592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:23:06.514730693 +0000 UTC m=+505.808419173" watchObservedRunningTime="2026-09-16 14:23:06.516902605 +0000 UTC m=+505.810591084"
Sep 16 14:23:17.271700 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.271661    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9f8647b69-mftxp"]
Sep 16 14:23:17.272175 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.271834    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9f8647b69-mftxp" podUID="8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc" containerName="manager" containerID="cri-o://99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520" gracePeriod=30
Sep 16 14:23:17.273531 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.273508    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:17.515010 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.514987    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:17.550840 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.550805    2582 generic.go:356] "Generic (PLEG): container finished" podID="8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc" containerID="99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520" exitCode=0
Sep 16 14:23:17.550988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.550900    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f8647b69-mftxp"
Sep 16 14:23:17.550988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.550945    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f8647b69-mftxp" event={"ID":"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc","Type":"ContainerDied","Data":"99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520"}
Sep 16 14:23:17.551117 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.551004    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f8647b69-mftxp" event={"ID":"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc","Type":"ContainerDied","Data":"4abe6e72d672b401b3076b91686ef8e7e1672c4dc9ac56b8047924c379cddead"}
Sep 16 14:23:17.551117 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.551040    2582 scope.go:117] "RemoveContainer" containerID="99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520"
Sep 16 14:23:17.561035 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.561014    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-metrics-certs\") pod \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") "
Sep 16 14:23:17.561145 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.561048    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-webhook-cert\") pod \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") "
Sep 16 14:23:17.561145 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.561139    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q95jw\" (UniqueName: \"kubernetes.io/projected/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-kube-api-access-q95jw\") pod \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\" (UID: \"8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc\") "
Sep 16 14:23:17.561539 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.561522    2582 scope.go:117] "RemoveContainer" containerID="99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520"
Sep 16 14:23:17.561913 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:23:17.561887    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520\": container with ID starting with 99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520 not found: ID does not exist" containerID="99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520"
Sep 16 14:23:17.562000 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.561923    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520"} err="failed to get container status \"99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520\": rpc error: code = NotFound desc = could not find container \"99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520\": container with ID starting with 99c4c1dd0fc4e2740f82daf9279698d7bbb964a191a3e1a09a7f1aa867fce520 not found: ID does not exist"
Sep 16 14:23:17.563228 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.563194    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc" (UID: "8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:23:17.563342 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.563276    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-kube-api-access-q95jw" (OuterVolumeSpecName: "kube-api-access-q95jw") pod "8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc" (UID: "8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc"). InnerVolumeSpecName "kube-api-access-q95jw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:23:17.563407 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.563352    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc" (UID: "8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:23:17.662450 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.662417    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q95jw\" (UniqueName: \"kubernetes.io/projected/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-kube-api-access-q95jw\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:23:17.662450 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.662447    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:23:17.662619 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.662459    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc-webhook-cert\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:23:17.874473 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.874442    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9f8647b69-mftxp"]
Sep 16 14:23:17.878644 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:17.878618    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9f8647b69-mftxp"]
Sep 16 14:23:19.179898 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:19.179864    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc" path="/var/lib/kubelet/pods/8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc/volumes"
Sep 16 14:23:37.726119 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:37.726042    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:37.827059 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:37.827027    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:39.153192 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.153154    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:39.258446 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.258415    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:39.354633 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.354593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:39.438554 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.438472    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:39.443413 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.443388    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"]
Sep 16 14:23:39.443798 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.443777    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc" containerName="manager"
Sep 16 14:23:39.443877 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.443809    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc" containerName="manager"
Sep 16 14:23:39.443877 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.443862    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ee1969f-3e23-4dfc-bf12-912ec3a5c3dc" containerName="manager"
Sep 16 14:23:39.449481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.449462    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.453739 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.453719    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 14:23:39.453860 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.453746    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 14:23:39.453860 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.453750    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 14:23:39.453860 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.453722    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qjgdq\""
Sep 16 14:23:39.453860 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.453822    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 16 14:23:39.460754 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.460731    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"]
Sep 16 14:23:39.528369 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.528338    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-metrics-certs\") pod \"maas-api-8488dbc8b7-4fxv8\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") " pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.528524 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.528379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-maas-api-tls\") pod \"maas-api-8488dbc8b7-4fxv8\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") " pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.528524 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.528400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khf9n\" (UniqueName: \"kubernetes.io/projected/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-kube-api-access-khf9n\") pod \"maas-api-8488dbc8b7-4fxv8\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") " pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.528524 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.528455    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-openshift-service-ca\") pod \"maas-api-8488dbc8b7-4fxv8\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") " pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.629874 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.629844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-metrics-certs\") pod \"maas-api-8488dbc8b7-4fxv8\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") " pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.630044 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.629884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-maas-api-tls\") pod \"maas-api-8488dbc8b7-4fxv8\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") " pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.630044 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.629906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khf9n\" (UniqueName: \"kubernetes.io/projected/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-kube-api-access-khf9n\") pod \"maas-api-8488dbc8b7-4fxv8\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") " pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.630044 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.629923    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-openshift-service-ca\") pod \"maas-api-8488dbc8b7-4fxv8\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") " pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.630698 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.630672    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-openshift-service-ca\") pod \"maas-api-8488dbc8b7-4fxv8\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") " pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.632539 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.632513    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-metrics-certs\") pod \"maas-api-8488dbc8b7-4fxv8\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") " pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.632668 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.632620    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-maas-api-tls\") pod \"maas-api-8488dbc8b7-4fxv8\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") " pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.637875 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.637855    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khf9n\" (UniqueName: \"kubernetes.io/projected/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-kube-api-access-khf9n\") pod \"maas-api-8488dbc8b7-4fxv8\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") " pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.761029 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.760953    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:39.816185 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.816157    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:39.912434 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:39.912401    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:40.012412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:40.012341    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:23:40.049569 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:40.049547    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"]
Sep 16 14:23:40.051322 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:23:40.051296    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc03d3f_9c45_4f5b_ae1f_ad313eb5330a.slice/crio-f1e3a594b990666ca524b253e78a93854c2141e7cef2f12546941cf1cdd8b941 WatchSource:0}: Error finding container f1e3a594b990666ca524b253e78a93854c2141e7cef2f12546941cf1cdd8b941: Status 404 returned error can't find the container with id f1e3a594b990666ca524b253e78a93854c2141e7cef2f12546941cf1cdd8b941
Sep 16 14:23:40.683110 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:40.683065    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8" event={"ID":"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a","Type":"ContainerStarted","Data":"f1e3a594b990666ca524b253e78a93854c2141e7cef2f12546941cf1cdd8b941"}
Sep 16 14:23:42.708691 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:42.708654    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8" event={"ID":"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a","Type":"ContainerStarted","Data":"fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52"}
Sep 16 14:23:42.709087 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:42.708763    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:42.741822 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:42.741777    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8" podStartSLOduration=1.8369764690000001 podStartE2EDuration="3.74176301s" totalImagesPullingTime="1.904786541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:23:42.738501359 +0000 UTC m=+542.032189840" watchObservedRunningTime="2026-09-16 14:23:42.74176301 +0000 UTC m=+542.035451550"
Sep 16 14:23:48.718873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:48.718844    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:23:49.746488 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:49.746450    2582 generic.go:356] "Generic (PLEG): container finished" podID="cd2871ba-e815-4278-85f3-2e4aa481d93f" containerID="57dce2be41216e2a31304e952703293116d465fe713f4be8c02cfedf9adcff89" exitCode=0
Sep 16 14:23:49.746901 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:49.746524    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw" event={"ID":"cd2871ba-e815-4278-85f3-2e4aa481d93f","Type":"ContainerDied","Data":"57dce2be41216e2a31304e952703293116d465fe713f4be8c02cfedf9adcff89"}
Sep 16 14:23:49.746901 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:49.746853    2582 scope.go:117] "RemoveContainer" containerID="57dce2be41216e2a31304e952703293116d465fe713f4be8c02cfedf9adcff89"
Sep 16 14:23:49.747869 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:49.747840    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:23:49.747958 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:49.747904    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:23:49.747958 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:49.747934    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:23:49.896390 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:49.896325    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:49.986716 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:49.986683    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:23:50.753901 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:50.753864    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw" event={"ID":"cd2871ba-e815-4278-85f3-2e4aa481d93f","Type":"ContainerStarted","Data":"1d337d617d3e7806a533bb81ccf05def5f94d3ba28166372ace211cea309b78c"}
Sep 16 14:23:50.780649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:50.780609    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:23:50.781716 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:50.781681    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cj4jw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 14:23:50.781850 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:50.781738    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw" podUID="cd2871ba-e815-4278-85f3-2e4aa481d93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 14:23:51.253961 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:51.253930    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:23:51.781194 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:51.781153    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cj4jw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 14:23:51.781878 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:51.781663    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw" podUID="cd2871ba-e815-4278-85f3-2e4aa481d93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 14:23:52.780657 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:52.780615    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cj4jw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 14:23:52.780870 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:52.780680    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw" podUID="cd2871ba-e815-4278-85f3-2e4aa481d93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 14:23:53.781335 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:53.781299    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cj4jw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 14:23:53.781907 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:53.781876    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw" podUID="cd2871ba-e815-4278-85f3-2e4aa481d93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 14:23:54.781211 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:54.781170    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cj4jw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 14:23:54.781432 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:54.781251    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw" podUID="cd2871ba-e815-4278-85f3-2e4aa481d93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 14:23:55.780510 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:55.780467    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cj4jw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 14:23:55.780721 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:55.780547    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw" podUID="cd2871ba-e815-4278-85f3-2e4aa481d93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 14:23:56.784305 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:56.784268    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:23:56.785128 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:23:56.785102    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw"
Sep 16 14:24:02.164501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:02.164454    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:24:02.649020 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:02.648981    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:24:16.273774 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:16.273742    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:24:39.037615 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.037586    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"]
Sep 16 14:24:39.041188 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.041166    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.045394 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.045370    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 14:24:39.045500 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.045377    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 14:24:39.045500 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.045377    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bm6t2\""
Sep 16 14:24:39.045500 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.045471    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 16 14:24:39.059314 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.059292    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"]
Sep 16 14:24:39.074537 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.074518    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:24:39.081790 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.081768    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.081886 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.081797    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.081886 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.081836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.081886 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.081857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nplt8\" (UniqueName: \"kubernetes.io/projected/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-kube-api-access-nplt8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.082018 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.081906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.082018 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.081934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.182651 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.182625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.182813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.182664    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.182813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.182700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.182813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.182723    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.182973 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.182881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.182973 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.182927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nplt8\" (UniqueName: \"kubernetes.io/projected/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-kube-api-access-nplt8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.183163 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.183140    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.183298 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.183211    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.183298 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.183253    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.185051 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.185023    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.185284 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.185263    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.194726 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.194704    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nplt8\" (UniqueName: \"kubernetes.io/projected/a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2-kube-api-access-nplt8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cml24\" (UID: \"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.351085 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.351003    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:39.625013 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.624975    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"]
Sep 16 14:24:39.626260 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:24:39.626221    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54366a4_ebf2_4bb9_8f3f_e9a4ff97d7a2.slice/crio-1ddb4fe84b689f3246609c178e58b4b3159266a038d2abfc5e0d31af71566473 WatchSource:0}: Error finding container 1ddb4fe84b689f3246609c178e58b4b3159266a038d2abfc5e0d31af71566473: Status 404 returned error can't find the container with id 1ddb4fe84b689f3246609c178e58b4b3159266a038d2abfc5e0d31af71566473
Sep 16 14:24:39.741247 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:39.741196    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:24:40.010204 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:40.010118    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24" event={"ID":"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2","Type":"ContainerStarted","Data":"1ddb4fe84b689f3246609c178e58b4b3159266a038d2abfc5e0d31af71566473"}
Sep 16 14:24:41.017119 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:41.017040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24" event={"ID":"a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2","Type":"ContainerStarted","Data":"040deb9daabcf6ab0869db077d0402a8e749768602b434fe4b3eaa26f45e8df7"}
Sep 16 14:24:49.351884 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:49.351847    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:49.352534 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:49.351918    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:49.364698 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:49.364672    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:49.394868 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:49.394825    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24" podStartSLOduration=9.40580462 podStartE2EDuration="10.394811391s" totalImagesPullingTime="989.006771ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:24:41.050800674 +0000 UTC m=+600.344489151" watchObservedRunningTime="2026-09-16 14:24:49.394811391 +0000 UTC m=+608.688499869"
Sep 16 14:24:50.077848 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:50.077820    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cml24"
Sep 16 14:24:54.254919 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:54.254888    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:24:55.217453 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:55.217421    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:24:55.997250 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:24:55.997202    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:25:04.447416 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:04.447335    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:25:04.548625 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:04.548593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:25:12.752890 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.752858    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"]
Sep 16 14:25:12.756184 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.756167    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.759133 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.759112    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 16 14:25:12.780750 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.780726    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"]
Sep 16 14:25:12.790722 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.790697    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:25:12.852280 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.852253    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3267cbc8-1d80-47cb-bd6a-342574468d23-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.852390 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.852285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3267cbc8-1d80-47cb-bd6a-342574468d23-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.852390 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.852329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3267cbc8-1d80-47cb-bd6a-342574468d23-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.852511 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.852405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3267cbc8-1d80-47cb-bd6a-342574468d23-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.852511 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.852431    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnwc9\" (UniqueName: \"kubernetes.io/projected/3267cbc8-1d80-47cb-bd6a-342574468d23-kube-api-access-xnwc9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.852511 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.852460    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3267cbc8-1d80-47cb-bd6a-342574468d23-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.953081 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.953053    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3267cbc8-1d80-47cb-bd6a-342574468d23-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.953081 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.953084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnwc9\" (UniqueName: \"kubernetes.io/projected/3267cbc8-1d80-47cb-bd6a-342574468d23-kube-api-access-xnwc9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.953299 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.953104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3267cbc8-1d80-47cb-bd6a-342574468d23-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.953299 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.953145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3267cbc8-1d80-47cb-bd6a-342574468d23-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.953299 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.953191    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3267cbc8-1d80-47cb-bd6a-342574468d23-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.953299 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.953257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3267cbc8-1d80-47cb-bd6a-342574468d23-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.953560 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.953538    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3267cbc8-1d80-47cb-bd6a-342574468d23-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.953640 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.953622    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3267cbc8-1d80-47cb-bd6a-342574468d23-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.953678 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.953654    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3267cbc8-1d80-47cb-bd6a-342574468d23-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.955312 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.955292    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3267cbc8-1d80-47cb-bd6a-342574468d23-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.955624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.955605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3267cbc8-1d80-47cb-bd6a-342574468d23-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:12.964825 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:12.964794    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnwc9\" (UniqueName: \"kubernetes.io/projected/3267cbc8-1d80-47cb-bd6a-342574468d23-kube-api-access-xnwc9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q4rks\" (UID: \"3267cbc8-1d80-47cb-bd6a-342574468d23\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:13.066373 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:13.066347    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:13.399865 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:25:13.399808    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3267cbc8_1d80_47cb_bd6a_342574468d23.slice/crio-0fe4308ac4e34d38d88b56f9ebd0fac9bf2d28feedb4f65bd821a6f0d5acfa68 WatchSource:0}: Error finding container 0fe4308ac4e34d38d88b56f9ebd0fac9bf2d28feedb4f65bd821a6f0d5acfa68: Status 404 returned error can't find the container with id 0fe4308ac4e34d38d88b56f9ebd0fac9bf2d28feedb4f65bd821a6f0d5acfa68
Sep 16 14:25:13.401335 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:13.401315    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:25:13.402291 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:13.402263    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"]
Sep 16 14:25:14.165916 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:14.165875    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:25:14.192452 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:14.192418    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks" event={"ID":"3267cbc8-1d80-47cb-bd6a-342574468d23","Type":"ContainerStarted","Data":"2cbb7789467205c2409d6bfe1b42af318cf33c5bd480debd8fe83009b18d4524"}
Sep 16 14:25:14.192595 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:14.192469    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks" event={"ID":"3267cbc8-1d80-47cb-bd6a-342574468d23","Type":"ContainerStarted","Data":"0fe4308ac4e34d38d88b56f9ebd0fac9bf2d28feedb4f65bd821a6f0d5acfa68"}
Sep 16 14:25:14.229540 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:14.229495    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks" podStartSLOduration=1.9840511090000001 podStartE2EDuration="2.229480189s" totalImagesPullingTime="245.42908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:25:14.229166566 +0000 UTC m=+633.522855045" watchObservedRunningTime="2026-09-16 14:25:14.229480189 +0000 UTC m=+633.523168665"
Sep 16 14:25:18.487884 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:18.487855    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:25:21.503112 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:21.503079    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:25:22.978254 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:22.978201    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:25:23.067278 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:23.067232    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:23.067425 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:23.067304    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:23.080225 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:23.080201    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:23.248652 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:23.248575    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q4rks"
Sep 16 14:25:27.444795 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:27.444751    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:25:29.725862 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:29.725830    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:25:37.987568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:37.987517    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:25:40.029319 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:40.029285    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:25:53.992631 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:53.992594    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:25:54.117357 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:54.117324    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:25:55.132460 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:55.132430    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:25:55.661230 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:25:55.661202    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:26:57.829200 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:26:57.829108    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:26:57.930222 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:26:57.930193    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:26:58.843380 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:26:58.843336    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:26:58.959867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:26:58.959823    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:26:59.064803 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:26:59.064771    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:18.487438 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.487380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:18.614041 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.614005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:18.713740 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.713684    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:18.846816 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.846786    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"]
Sep 16 14:27:18.850218 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.850199    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:18.854775 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.854751    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-5d484d-openshift-default-dockercfg-7fbnx\""
Sep 16 14:27:18.862135 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.862113    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"]
Sep 16 14:27:18.880745 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.880718    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:18.985420 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.985392    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-data\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:18.985571 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.985431    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istiod-ca-cert\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:18.985571 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.985462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-credential-socket\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:18.985571 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.985487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-podinfo\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:18.985571 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.985512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6gmp\" (UniqueName: \"kubernetes.io/projected/c40e824f-371d-4ffd-9a4a-bc456034ae9f-kube-api-access-c6gmp\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:18.985571 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.985538    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-workload-socket\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:18.985571 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.985554    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-envoy\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:18.985773 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.985579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-token\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:18.985773 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.985595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-workload-certs\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:18.991053 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:18.991031    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:19.007034 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.007009    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"]
Sep 16 14:27:19.010929 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.010910    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.014026 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.014005    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-924916-openshift-default-dockercfg-chsjd\""
Sep 16 14:27:19.022553 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.022533    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"]
Sep 16 14:27:19.060637 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.060609    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:19.086204 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.086175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-data\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.086355 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.086221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istiod-ca-cert\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.086355 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.086279    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-credential-socket\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.086355 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.086307    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-podinfo\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.086691 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.086671    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-data\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.086776 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.086692    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-credential-socket\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.086776 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.086742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6gmp\" (UniqueName: \"kubernetes.io/projected/c40e824f-371d-4ffd-9a4a-bc456034ae9f-kube-api-access-c6gmp\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.086890 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.086780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-workload-socket\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.086890 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.086800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-envoy\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.087080 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.087056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-token\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.087193 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.087119    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-workload-socket\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.087193 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.087143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-workload-certs\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.087346 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.087057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istiod-ca-cert\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.087430 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.087404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-workload-certs\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.088975 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.088944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-envoy\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.089061 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.089020    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-podinfo\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.095794 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.095774    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-token\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.096137 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.096110    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6gmp\" (UniqueName: \"kubernetes.io/projected/c40e824f-371d-4ffd-9a4a-bc456034ae9f-kube-api-access-c6gmp\") pod \"e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") " pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.161867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.161824    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:19.188417 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.188386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-workload-socket\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.188558 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.188473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-data\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.188558 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.188511    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-credential-socket\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.188558 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.188542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-podinfo\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.188698 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.188606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-workload-certs\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.188698 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.188662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-envoy\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.188782 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.188716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istiod-ca-cert\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.188782 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.188734    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkl2g\" (UniqueName: \"kubernetes.io/projected/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-kube-api-access-gkl2g\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.188782 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.188752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-token\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.219798 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.219752    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:19.289182 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.289150    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-podinfo\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.289352 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.289194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-workload-certs\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.289352 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.289228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-envoy\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.289352 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.289302    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istiod-ca-cert\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.289352 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.289332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkl2g\" (UniqueName: \"kubernetes.io/projected/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-kube-api-access-gkl2g\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.289588 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.289356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-token\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.289588 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.289419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-workload-socket\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.289588 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.289478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-data\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.289588 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.289512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-credential-socket\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.289810 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.289623    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-workload-certs\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.289865 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.289817    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-credential-socket\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.289938 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.289885    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-workload-socket\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.290131 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.290090    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-data\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.290131 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.290117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istiod-ca-cert\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.291726 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.291692    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-envoy\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.291858 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.291844    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-podinfo\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.298224 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.298199    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-token\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.298224 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.298213    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkl2g\" (UniqueName: \"kubernetes.io/projected/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-kube-api-access-gkl2g\") pod \"e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") " pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.317789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.317730    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:19.320644 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.320626    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:19.441181 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.441150    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"]
Sep 16 14:27:19.443128 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:27:19.443100    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40e824f_371d_4ffd_9a4a_bc456034ae9f.slice/crio-0904e8c39d2c909622280b400a4201c049996ffdb474805bb8c82d5b29aeb464 WatchSource:0}: Error finding container 0904e8c39d2c909622280b400a4201c049996ffdb474805bb8c82d5b29aeb464: Status 404 returned error can't find the container with id 0904e8c39d2c909622280b400a4201c049996ffdb474805bb8c82d5b29aeb464
Sep 16 14:27:19.445385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.445355    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:27:19.445467 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.445423    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:27:19.445467 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.445453    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:27:19.606395 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.606360    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"]
Sep 16 14:27:19.608395 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:27:19.608366    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e5d9ef_64d2_4a16_bde6_a48e40a0046e.slice/crio-70043d80c92005b51c413b8daf388acd9d4a0b32ea29db1188540675ec22ee67 WatchSource:0}: Error finding container 70043d80c92005b51c413b8daf388acd9d4a0b32ea29db1188540675ec22ee67: Status 404 returned error can't find the container with id 70043d80c92005b51c413b8daf388acd9d4a0b32ea29db1188540675ec22ee67
Sep 16 14:27:19.611144 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.611107    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:27:19.611222 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.611198    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:27:19.611288 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.611256    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:27:19.831729 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.831681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" event={"ID":"c40e824f-371d-4ffd-9a4a-bc456034ae9f","Type":"ContainerStarted","Data":"06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f"}
Sep 16 14:27:19.831919 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.831768    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" event={"ID":"c40e824f-371d-4ffd-9a4a-bc456034ae9f","Type":"ContainerStarted","Data":"0904e8c39d2c909622280b400a4201c049996ffdb474805bb8c82d5b29aeb464"}
Sep 16 14:27:19.833899 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.833868    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" event={"ID":"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e","Type":"ContainerStarted","Data":"ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07"}
Sep 16 14:27:19.834051 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.833921    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" event={"ID":"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e","Type":"ContainerStarted","Data":"70043d80c92005b51c413b8daf388acd9d4a0b32ea29db1188540675ec22ee67"}
Sep 16 14:27:19.869732 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.869675    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" podStartSLOduration=1.869659314 podStartE2EDuration="1.869659314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:27:19.868485461 +0000 UTC m=+759.162173940" watchObservedRunningTime="2026-09-16 14:27:19.869659314 +0000 UTC m=+759.163347792"
Sep 16 14:27:19.896954 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.896922    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:19.911637 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.911566    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" podStartSLOduration=1.911543039 podStartE2EDuration="1.911543039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:27:19.90754832 +0000 UTC m=+759.201237029" watchObservedRunningTime="2026-09-16 14:27:19.911543039 +0000 UTC m=+759.205231550"
Sep 16 14:27:19.989537 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:19.989505    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:20.162301 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:20.162216    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:20.166974 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:20.166949    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:20.321401 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:20.321369    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:20.325997 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:20.325975    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:20.357141 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:20.357116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:20.839221 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:20.839131    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:20.839221 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:20.839198    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:20.839961 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:20.839943    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:20.840092 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:20.840082    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:21.679965 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:21.679932    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:21.772902 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:21.772873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:21.872736 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:21.872706    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:21.975675 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:21.975597    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:22.076542 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:22.076506    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:22.529193 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:22.526191    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:27:22.894453 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:22.894423    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"]
Sep 16 14:27:22.898008 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:22.897991    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:22.900474 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:22.900452    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-094dab-serving-cert\""
Sep 16 14:27:22.907667 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:22.907643    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"]
Sep 16 14:27:22.917334 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:22.917308    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwbnd\" (UniqueName: \"kubernetes.io/projected/818edb12-7d23-43fc-b6c7-eebc212d8baf-kube-api-access-lwbnd\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:22.917434 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:22.917355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-maas-api-tls\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:22.917434 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:22.917403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/818edb12-7d23-43fc-b6c7-eebc212d8baf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:22.917567 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:22.917470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-metrics-certs\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:23.006258 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.006200    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:23.018488 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.018459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwbnd\" (UniqueName: \"kubernetes.io/projected/818edb12-7d23-43fc-b6c7-eebc212d8baf-kube-api-access-lwbnd\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:23.018603 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.018504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-maas-api-tls\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:23.018603 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.018526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/818edb12-7d23-43fc-b6c7-eebc212d8baf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:23.018603 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.018541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-metrics-certs\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:23.018743 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:27:23.018612    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-serving-cert: secret "maas-api-e2e-inf-a-094dab-serving-cert" not found
Sep 16 14:27:23.018743 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:27:23.018678    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-maas-api-tls podName:818edb12-7d23-43fc-b6c7-eebc212d8baf nodeName:}" failed. No retries permitted until 2026-09-16 14:27:23.518663659 +0000 UTC m=+762.812352121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-maas-api-tls") pod "maas-api-e2e-inf-a-094dab-5f7974584f-57cr6" (UID: "818edb12-7d23-43fc-b6c7-eebc212d8baf") : secret "maas-api-e2e-inf-a-094dab-serving-cert" not found
Sep 16 14:27:23.019261 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.019214    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/818edb12-7d23-43fc-b6c7-eebc212d8baf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:23.021084 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.021063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-metrics-certs\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:23.026913 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.026895    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwbnd\" (UniqueName: \"kubernetes.io/projected/818edb12-7d23-43fc-b6c7-eebc212d8baf-kube-api-access-lwbnd\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:23.109213 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.109182    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:23.205754 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.205679    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:23.522858 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.522764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-maas-api-tls\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:23.525220 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.525193    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-maas-api-tls\") pod \"maas-api-e2e-inf-a-094dab-5f7974584f-57cr6\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:23.720541 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.720504    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:23.808862 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.808822    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:23.866138 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:23.866091    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:24.101020 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.100994    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"]
Sep 16 14:27:24.103437 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:27:24.103411    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818edb12_7d23_43fc_b6c7_eebc212d8baf.slice/crio-20964ac68573e1f57b02ea1f9c436e356cb086617929d91a9916fe50b631f203 WatchSource:0}: Error finding container 20964ac68573e1f57b02ea1f9c436e356cb086617929d91a9916fe50b631f203: Status 404 returned error can't find the container with id 20964ac68573e1f57b02ea1f9c436e356cb086617929d91a9916fe50b631f203
Sep 16 14:27:24.314155 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.314121    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"]
Sep 16 14:27:24.318959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.318935    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.322030 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.322008    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-5d484d-serving-cert\""
Sep 16 14:27:24.330896 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.330875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-metrics-certs\") pod \"maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.330980 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.330934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.331065 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.331043    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wqs6\" (UniqueName: \"kubernetes.io/projected/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-kube-api-access-7wqs6\") pod \"maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.331161 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.331101    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-maas-api-tls\") pod \"maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.335476 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.335454    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"]
Sep 16 14:27:24.372892 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.372832    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:24.431710 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.431683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wqs6\" (UniqueName: \"kubernetes.io/projected/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-kube-api-access-7wqs6\") pod \"maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.431846 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.431725    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-maas-api-tls\") pod \"maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.431846 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.431750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-metrics-certs\") pod \"maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.431846 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.431799    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.432472 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.432450    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.434198 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.434179    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-metrics-certs\") pod \"maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.434280 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.434262    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-maas-api-tls\") pod \"maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.443664 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.443643    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wqs6\" (UniqueName: \"kubernetes.io/projected/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-kube-api-access-7wqs6\") pod \"maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.483026 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.483003    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:24.630904 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.630836    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:24.863793 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.863754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6" event={"ID":"818edb12-7d23-43fc-b6c7-eebc212d8baf","Type":"ContainerStarted","Data":"b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3"}
Sep 16 14:27:24.863953 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.863814    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6" event={"ID":"818edb12-7d23-43fc-b6c7-eebc212d8baf","Type":"ContainerStarted","Data":"20964ac68573e1f57b02ea1f9c436e356cb086617929d91a9916fe50b631f203"}
Sep 16 14:27:24.864011 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.863970    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:24.892745 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.892660    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6" podStartSLOduration=2.442939685 podStartE2EDuration="2.892645842s" totalImagesPullingTime="449.706157ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:27:24.890905666 +0000 UTC m=+764.184594146" watchObservedRunningTime="2026-09-16 14:27:24.892645842 +0000 UTC m=+764.186334320"
Sep 16 14:27:24.909000 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.908977    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"]
Sep 16 14:27:24.910107 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:27:24.910083    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e4cdf7_f50c_4b2f_b450_58dcd08bf651.slice/crio-aceb9c7c6ea389c190261ecf420c1f0005d31fd24c14f071d89363ef6b2f2f45 WatchSource:0}: Error finding container aceb9c7c6ea389c190261ecf420c1f0005d31fd24c14f071d89363ef6b2f2f45: Status 404 returned error can't find the container with id aceb9c7c6ea389c190261ecf420c1f0005d31fd24c14f071d89363ef6b2f2f45
Sep 16 14:27:24.999215 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:24.999175    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:25.505629 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.505550    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"]
Sep 16 14:27:25.509173 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.509154    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:25.511972 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.511951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-924916-serving-cert\""
Sep 16 14:27:25.521566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.521540    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"]
Sep 16 14:27:25.541716 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.541695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:25.541808 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.541721    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbgq9\" (UniqueName: \"kubernetes.io/projected/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-kube-api-access-mbgq9\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:25.541808 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.541745    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-maas-api-tls\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:25.541808 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.541801    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-metrics-certs\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:25.642694 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.642658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:25.642694 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.642695    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbgq9\" (UniqueName: \"kubernetes.io/projected/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-kube-api-access-mbgq9\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:25.642918 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.642721    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-maas-api-tls\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:25.642918 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.642748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-metrics-certs\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:25.642918 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:27:25.642832    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-serving-cert: secret "maas-api-e2e-worker-w0-924916-serving-cert" not found
Sep 16 14:27:25.642918 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:27:25.642895    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-maas-api-tls podName:d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5 nodeName:}" failed. No retries permitted until 2026-09-16 14:27:26.142879171 +0000 UTC m=+765.436567627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-maas-api-tls") pod "maas-api-e2e-worker-w0-924916-8444f76f79-4df4q" (UID: "d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5") : secret "maas-api-e2e-worker-w0-924916-serving-cert" not found
Sep 16 14:27:25.643465 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.643443    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:25.645188 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.645171    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-metrics-certs\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:25.654433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.654413    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbgq9\" (UniqueName: \"kubernetes.io/projected/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-kube-api-access-mbgq9\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:25.854865 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.854830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:25.871454 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.871430    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk" event={"ID":"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651","Type":"ContainerStarted","Data":"213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8"}
Sep 16 14:27:25.871563 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.871475    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk" event={"ID":"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651","Type":"ContainerStarted","Data":"aceb9c7c6ea389c190261ecf420c1f0005d31fd24c14f071d89363ef6b2f2f45"}
Sep 16 14:27:25.893651 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.893608    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk" podStartSLOduration=1.57497043 podStartE2EDuration="1.893594634s" totalImagesPullingTime="318.624204ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:27:25.891486771 +0000 UTC m=+765.185175263" watchObservedRunningTime="2026-09-16 14:27:25.893594634 +0000 UTC m=+765.187283143"
Sep 16 14:27:25.955289 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:25.955263    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:26.147773 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:26.147674    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-maas-api-tls\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:26.150092 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:26.150065    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-maas-api-tls\") pod \"maas-api-e2e-worker-w0-924916-8444f76f79-4df4q\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:26.160579 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:26.160546    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:26.247378 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:26.247343    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:26.420339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:26.420259    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:26.543928 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:26.543900    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:26.644427 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:26.644391    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:26.691505 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:26.691483    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"]
Sep 16 14:27:26.692644 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:27:26.692610    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04fb1fe_2ee5_4da8_a5f3_709a0644e6f5.slice/crio-9911bc7f0862ed64477d978c426552f106cd683c91318732e89ae342c2d01a2a WatchSource:0}: Error finding container 9911bc7f0862ed64477d978c426552f106cd683c91318732e89ae342c2d01a2a: Status 404 returned error can't find the container with id 9911bc7f0862ed64477d978c426552f106cd683c91318732e89ae342c2d01a2a
Sep 16 14:27:26.878114 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:26.878076    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q" event={"ID":"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5","Type":"ContainerStarted","Data":"9911bc7f0862ed64477d978c426552f106cd683c91318732e89ae342c2d01a2a"}
Sep 16 14:27:26.878511 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:26.878487    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:26.911474 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:26.911448    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:27.010190 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:27.010114    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:27.320812 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:27.320777    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:27.884599 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:27.884567    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q" event={"ID":"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5","Type":"ContainerStarted","Data":"e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569"}
Sep 16 14:27:27.884964 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:27.884810    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:27.903076 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:27.903031    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q" podStartSLOduration=2.539996807 podStartE2EDuration="2.903013982s" totalImagesPullingTime="363.017175ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:27:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:27:27.902119979 +0000 UTC m=+767.195808457" watchObservedRunningTime="2026-09-16 14:27:27.903013982 +0000 UTC m=+767.196702464"
Sep 16 14:27:28.231867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:28.231786    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:28.723466 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:28.723435    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:28.822401 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:28.822369    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:28.935611 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:28.935582    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:29.120617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:29.120586    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:29.250010 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:29.249973    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:29.736060 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:29.736025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:29.832317 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:29.832279    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:30.021261 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:30.021149    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:30.819315 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:30.819282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:30.895979 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:30.895943    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:27:31.822589 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:31.822552    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:32.245650 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.245563    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:32.348749 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.348711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:32.587204 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.587165    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"]
Sep 16 14:27:32.599596 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.599571    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:32.604883 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.604725    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-84fdff-serving-cert\""
Sep 16 14:27:32.608844 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.608819    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"]
Sep 16 14:27:32.619615 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.619591    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:32.709284 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.709250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-metrics-certs\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:32.709462 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.709338    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-maas-api-tls\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:32.709462 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.709369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba4000e-060c-4e5f-9384-c43228366a87-openshift-service-ca\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:32.709462 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.709385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f2h9\" (UniqueName: \"kubernetes.io/projected/cba4000e-060c-4e5f-9384-c43228366a87-kube-api-access-6f2h9\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:32.719812 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.719777    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:32.810488 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.810456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-maas-api-tls\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:32.810664 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.810497    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba4000e-060c-4e5f-9384-c43228366a87-openshift-service-ca\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:32.810664 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.810515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f2h9\" (UniqueName: \"kubernetes.io/projected/cba4000e-060c-4e5f-9384-c43228366a87-kube-api-access-6f2h9\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:32.810664 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:27:32.810609    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-serving-cert: secret "maas-api-e2e-autores-84fdff-serving-cert" not found
Sep 16 14:27:32.810833 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:27:32.810681    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-maas-api-tls podName:cba4000e-060c-4e5f-9384-c43228366a87 nodeName:}" failed. No retries permitted until 2026-09-16 14:27:33.310664824 +0000 UTC m=+772.604353285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-maas-api-tls") pod "maas-api-e2e-autores-84fdff-67f8c945c-hk2sc" (UID: "cba4000e-060c-4e5f-9384-c43228366a87") : secret "maas-api-e2e-autores-84fdff-serving-cert" not found
Sep 16 14:27:32.810833 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.810608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-metrics-certs\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:32.811147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.811127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba4000e-060c-4e5f-9384-c43228366a87-openshift-service-ca\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:32.812994 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.812971    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-metrics-certs\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:32.819130 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.819105    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f2h9\" (UniqueName: \"kubernetes.io/projected/cba4000e-060c-4e5f-9384-c43228366a87-kube-api-access-6f2h9\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:32.897423 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:32.897352    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:27:33.291117 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.291084    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:33.315844 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.315814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-maas-api-tls\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:33.318402 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.318378    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-maas-api-tls\") pod \"maas-api-e2e-autores-84fdff-67f8c945c-hk2sc\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:33.416713 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.416659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:33.518650 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.518601    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:33.701697 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.701653    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"]
Sep 16 14:27:33.707276 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.707225    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:33.710352 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.710271    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1e4514fd-serving-cert\""
Sep 16 14:27:33.727985 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.727963    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-metrics-certs\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:33.728087 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.728032    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kls2x\" (UniqueName: \"kubernetes.io/projected/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-kube-api-access-kls2x\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:33.728087 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.728060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-maas-api-tls\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:33.728087 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.728078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-openshift-service-ca\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:33.733572 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.733550    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"]
Sep 16 14:27:33.749602 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.749570    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:33.822767 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.822741    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"]
Sep 16 14:27:33.825638 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:27:33.824930    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba4000e_060c_4e5f_9384_c43228366a87.slice/crio-826eeb718b2723fd05f6c2a098d617496cdd2fed0bf81b56bf841554e95410ee WatchSource:0}: Error finding container 826eeb718b2723fd05f6c2a098d617496cdd2fed0bf81b56bf841554e95410ee: Status 404 returned error can't find the container with id 826eeb718b2723fd05f6c2a098d617496cdd2fed0bf81b56bf841554e95410ee
Sep 16 14:27:33.829574 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.829550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-metrics-certs\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:33.829660 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.829646    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kls2x\" (UniqueName: \"kubernetes.io/projected/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-kube-api-access-kls2x\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:33.829699 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.829688    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-maas-api-tls\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:33.829733 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.829715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-openshift-service-ca\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:33.830139 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:27:33.830115    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-serving-cert: secret "maas-api-e2e-ait-1e4514fd-serving-cert" not found
Sep 16 14:27:33.830378 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:27:33.830363    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-maas-api-tls podName:bb0d4fd0-1987-42c8-9912-c0d8ece283b6 nodeName:}" failed. No retries permitted until 2026-09-16 14:27:34.330340076 +0000 UTC m=+773.624028547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-maas-api-tls") pod "maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq" (UID: "bb0d4fd0-1987-42c8-9912-c0d8ece283b6") : secret "maas-api-e2e-ait-1e4514fd-serving-cert" not found
Sep 16 14:27:33.830507 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.830455    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-openshift-service-ca\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:33.832210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.832183    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-metrics-certs\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:33.840381 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.840346    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kls2x\" (UniqueName: \"kubernetes.io/projected/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-kube-api-access-kls2x\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:33.862574 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.862528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:33.899192 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.899165    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:27:33.925416 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:33.925388    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc" event={"ID":"cba4000e-060c-4e5f-9384-c43228366a87","Type":"ContainerStarted","Data":"826eeb718b2723fd05f6c2a098d617496cdd2fed0bf81b56bf841554e95410ee"}
Sep 16 14:27:34.220072 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:34.220040    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:34.326698 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:34.326659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:34.334752 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:34.334727    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-maas-api-tls\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:34.337288 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:34.337268    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-maas-api-tls\") pod \"maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:34.462110 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:34.462009    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:34.619099 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:34.619067    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:34.933417 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:34.933174    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc" event={"ID":"cba4000e-060c-4e5f-9384-c43228366a87","Type":"ContainerStarted","Data":"25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d"}
Sep 16 14:27:34.933417 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:34.933279    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:34.935852 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:34.935832    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"]
Sep 16 14:27:34.937697 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:27:34.937668    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb0d4fd0_1987_42c8_9912_c0d8ece283b6.slice/crio-f309f2aea20a3f96a1c18d5f615b7b79a2504d718431a304152be1eb4eb3647e WatchSource:0}: Error finding container f309f2aea20a3f96a1c18d5f615b7b79a2504d718431a304152be1eb4eb3647e: Status 404 returned error can't find the container with id f309f2aea20a3f96a1c18d5f615b7b79a2504d718431a304152be1eb4eb3647e
Sep 16 14:27:34.953857 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:34.953806    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc" podStartSLOduration=2.579869427 podStartE2EDuration="2.953788631s" totalImagesPullingTime="373.919204ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:27:34.951953829 +0000 UTC m=+774.245642309" watchObservedRunningTime="2026-09-16 14:27:34.953788631 +0000 UTC m=+774.247477111"
Sep 16 14:27:35.243575 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:35.243498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:35.734466 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:35.734435    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:35.918405 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:35.918368    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:27:35.940849 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:35.940809    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq" event={"ID":"bb0d4fd0-1987-42c8-9912-c0d8ece283b6","Type":"ContainerStarted","Data":"8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc"}
Sep 16 14:27:35.941348 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:35.940865    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq" event={"ID":"bb0d4fd0-1987-42c8-9912-c0d8ece283b6","Type":"ContainerStarted","Data":"f309f2aea20a3f96a1c18d5f615b7b79a2504d718431a304152be1eb4eb3647e"}
Sep 16 14:27:35.959677 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:35.959503    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq" podStartSLOduration=2.174470594 podStartE2EDuration="2.95948371s" totalImagesPullingTime="785.013116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:27:35.959340489 +0000 UTC m=+775.253028970" watchObservedRunningTime="2026-09-16 14:27:35.95948371 +0000 UTC m=+775.253172191"
Sep 16 14:27:36.628297 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:36.628257    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:36.880453 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:36.880356    2582 patch_prober.go:28] interesting pod/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 14:27:36.880453 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:36.880413    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 14:27:36.947060 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:36.947025    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:37.498028 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:37.497987    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:38.294638 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:38.294499    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:38.958531 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:38.958501    2582 generic.go:356] "Generic (PLEG): container finished" podID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerID="06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f" exitCode=0
Sep 16 14:27:38.958705 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:38.958580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" event={"ID":"c40e824f-371d-4ffd-9a4a-bc456034ae9f","Type":"ContainerDied","Data":"06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f"}
Sep 16 14:27:38.959023 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:38.958998    2582 scope.go:117] "RemoveContainer" containerID="06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f"
Sep 16 14:27:38.960095 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:38.960065    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:27:38.960167 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:38.960152    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:27:38.960219 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:38.960205    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:27:39.004893 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:39.004866    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:39.764665 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:39.764621    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:39.966498 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:39.966465    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" event={"ID":"c40e824f-371d-4ffd-9a4a-bc456034ae9f","Type":"ContainerStarted","Data":"ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184"}
Sep 16 14:27:40.162698 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:40.162586    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:40.162903 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:40.162881    2582 patch_prober.go:28] interesting pod/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 14:27:40.162982 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:40.162927    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 14:27:40.535943 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:40.535843    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:40.945629 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:40.945591    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:27:41.162196 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:41.162162    2582 patch_prober.go:28] interesting pod/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 14:27:41.162408 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:41.162211    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 14:27:41.311099 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:41.311062    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:41.414531 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:41.414490    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:41.689570 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:41.689452    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:41.789568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:41.789472    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:42.024316 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:42.024206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:42.162446 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:42.162408    2582 patch_prober.go:28] interesting pod/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 14:27:42.162641 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:42.162460    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 14:27:42.187562 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:42.187518    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:42.291879 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:42.291850    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:42.392951 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:42.392911    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:42.948988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:42.948949    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:42.957444 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:42.957419    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:43.162769 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:43.162732    2582 patch_prober.go:28] interesting pod/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 14:27:43.163160 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:43.162793    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 14:27:44.162970 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:44.162928    2582 patch_prober.go:28] interesting pod/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 14:27:44.163469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:44.162998    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 14:27:44.241732 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:44.241698    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:44.348926 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:44.348886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:44.450257 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:44.450145    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:44.652051 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:44.652011    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:44.910913 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:44.910878    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:45.162515 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:45.162420    2582 patch_prober.go:28] interesting pod/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 14:27:45.162515 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:45.162484    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 14:27:45.525818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:45.525734    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:45.630206 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:45.630151    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:46.165681 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:46.165654    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:46.166053 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:46.166027    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:46.166765 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:46.166748    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:27:46.416136 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:46.416054    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:46.861544 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:46.861508    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:47.017198 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:47.017157    2582 generic.go:356] "Generic (PLEG): container finished" podID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerID="ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07" exitCode=0
Sep 16 14:27:47.017374 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:47.017258    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" event={"ID":"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e","Type":"ContainerDied","Data":"ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07"}
Sep 16 14:27:47.017840 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:47.017822    2582 scope.go:117] "RemoveContainer" containerID="ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07"
Sep 16 14:27:47.018914 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:47.018881    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:27:47.019024 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:47.018966    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:27:47.019024 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:47.019014    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:27:47.482194 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:47.482155    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:48.027039 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:48.027003    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" event={"ID":"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e","Type":"ContainerStarted","Data":"747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015"}
Sep 16 14:27:48.192838 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:48.192809    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:48.321608 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:48.321569    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:48.322891 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:48.322861    2582 patch_prober.go:28] interesting pod/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 14:27:48.323031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:48.322921    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 14:27:49.296546 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.295769    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"]
Sep 16 14:27:49.301229 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.301205    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"]
Sep 16 14:27:49.301402 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.301338    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:49.305840 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.305816    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-d0b89a-serving-cert\""
Sep 16 14:27:49.321585 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.321560    2582 patch_prober.go:28] interesting pod/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 14:27:49.321687 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.321603    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 14:27:49.337725 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.337701    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:49.412345 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.412313    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:49.415528 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.415505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-metrics-certs\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:49.415592 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.415556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmrgw\" (UniqueName: \"kubernetes.io/projected/6bfaf04a-cf04-46db-a285-1bc7710784b6-kube-api-access-jmrgw\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:49.415647 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.415633    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-maas-api-tls\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:49.415685 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.415673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bfaf04a-cf04-46db-a285-1bc7710784b6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:49.517038 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.517003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmrgw\" (UniqueName: \"kubernetes.io/projected/6bfaf04a-cf04-46db-a285-1bc7710784b6-kube-api-access-jmrgw\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:49.517187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.517168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-maas-api-tls\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:49.517278 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.517215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bfaf04a-cf04-46db-a285-1bc7710784b6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:49.517344 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.517323    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-metrics-certs\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:49.517405 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:27:49.517337    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-serving-cert: secret "maas-api-e2e-inf-b-d0b89a-serving-cert" not found
Sep 16 14:27:49.517459 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:27:49.517416    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-maas-api-tls podName:6bfaf04a-cf04-46db-a285-1bc7710784b6 nodeName:}" failed. No retries permitted until 2026-09-16 14:27:50.017391543 +0000 UTC m=+789.311080014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-maas-api-tls") pod "maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44" (UID: "6bfaf04a-cf04-46db-a285-1bc7710784b6") : secret "maas-api-e2e-inf-b-d0b89a-serving-cert" not found
Sep 16 14:27:49.518030 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.518001    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bfaf04a-cf04-46db-a285-1bc7710784b6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:49.519789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.519772    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-metrics-certs\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:49.531647 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.531618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmrgw\" (UniqueName: \"kubernetes.io/projected/6bfaf04a-cf04-46db-a285-1bc7710784b6-kube-api-access-jmrgw\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:49.793629 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.793596    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:49.952810 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:49.952774    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:50.021630 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:50.021593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-maas-api-tls\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:50.023927 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:50.023903    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-maas-api-tls\") pod \"maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:50.034797 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:50.034768    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:50.212902 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:50.212814    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:50.321747 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:50.321714    2582 patch_prober.go:28] interesting pod/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 14:27:50.322083 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:50.321782    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 14:27:50.362853 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:50.362823    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:50.494729 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:50.491226    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"]
Sep 16 14:27:50.494729 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:27:50.494524    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bfaf04a_cf04_46db_a285_1bc7710784b6.slice/crio-631a5af341dfdcd8f197d9afc60982bfa0f28f10dca39cd8ddc28d2c7edd1c8b WatchSource:0}: Error finding container 631a5af341dfdcd8f197d9afc60982bfa0f28f10dca39cd8ddc28d2c7edd1c8b: Status 404 returned error can't find the container with id 631a5af341dfdcd8f197d9afc60982bfa0f28f10dca39cd8ddc28d2c7edd1c8b
Sep 16 14:27:50.839348 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:50.839317    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:51.046815 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:51.046779    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44" event={"ID":"6bfaf04a-cf04-46db-a285-1bc7710784b6","Type":"ContainerStarted","Data":"5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8"}
Sep 16 14:27:51.046943 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:51.046859    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:51.046943 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:51.046913    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44" event={"ID":"6bfaf04a-cf04-46db-a285-1bc7710784b6","Type":"ContainerStarted","Data":"631a5af341dfdcd8f197d9afc60982bfa0f28f10dca39cd8ddc28d2c7edd1c8b"}
Sep 16 14:27:51.069760 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:51.069708    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44" podStartSLOduration=1.6475449659999999 podStartE2EDuration="2.069694164s" totalImagesPullingTime="422.149198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:27:51.066823449 +0000 UTC m=+790.360511928" watchObservedRunningTime="2026-09-16 14:27:51.069694164 +0000 UTC m=+790.363382643"
Sep 16 14:27:51.321393 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:51.321352    2582 patch_prober.go:28] interesting pod/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 14:27:51.321562 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:51.321430    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 14:27:51.411464 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:51.411434    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:52.151406 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:52.151327    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:52.321592 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:52.321553    2582 patch_prober.go:28] interesting pod/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 14:27:52.321758 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:52.321617    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 14:27:52.966497 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:52.966467    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:53.321765 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:53.321731    2582 patch_prober.go:28] interesting pod/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 14:27:53.321931 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:53.321798    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 14:27:53.940798 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:53.940765    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:54.325207 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:54.325179    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:54.326334 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:54.326313    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:27:54.655458 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:54.655380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:54.974261 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:54.974150    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:55.554866 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:55.554836    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:56.349540 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:56.349507    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:57.058462 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:57.058435    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:27:58.000740 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.000712    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"]
Sep 16 14:27:58.000962 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.000941    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq" podUID="bb0d4fd0-1987-42c8-9912-c0d8ece283b6" containerName="maas-api" containerID="cri-o://8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc" gracePeriod=30
Sep 16 14:27:58.042049 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.042008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:58.135374 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.135344    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:58.234481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.234142    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:58.249870 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.249848    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:58.332404 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.332366    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:58.397275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.397221    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-metrics-certs\") pod \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") "
Sep 16 14:27:58.397440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.397279    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kls2x\" (UniqueName: \"kubernetes.io/projected/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-kube-api-access-kls2x\") pod \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") "
Sep 16 14:27:58.397440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.397351    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-maas-api-tls\") pod \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") "
Sep 16 14:27:58.397440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.397415    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-openshift-service-ca\") pod \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\" (UID: \"bb0d4fd0-1987-42c8-9912-c0d8ece283b6\") "
Sep 16 14:27:58.398064 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.398021    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb0d4fd0-1987-42c8-9912-c0d8ece283b6" (UID: "bb0d4fd0-1987-42c8-9912-c0d8ece283b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:27:58.400372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.400343    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-kube-api-access-kls2x" (OuterVolumeSpecName: "kube-api-access-kls2x") pod "bb0d4fd0-1987-42c8-9912-c0d8ece283b6" (UID: "bb0d4fd0-1987-42c8-9912-c0d8ece283b6"). InnerVolumeSpecName "kube-api-access-kls2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:27:58.404979 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.404921    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb0d4fd0-1987-42c8-9912-c0d8ece283b6" (UID: "bb0d4fd0-1987-42c8-9912-c0d8ece283b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:27:58.405994 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.405961    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bb0d4fd0-1987-42c8-9912-c0d8ece283b6" (UID: "bb0d4fd0-1987-42c8-9912-c0d8ece283b6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:27:58.462527 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.462499    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:58.498907 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.498878    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:27:58.498907 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.498900    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kls2x\" (UniqueName: \"kubernetes.io/projected/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-kube-api-access-kls2x\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:27:58.498907 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.498910    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:27:58.499102 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.498919    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb0d4fd0-1987-42c8-9912-c0d8ece283b6-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:27:58.712654 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:58.712561    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:59.001808 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.001729    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:59.093775 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.093744    2582 generic.go:356] "Generic (PLEG): container finished" podID="bb0d4fd0-1987-42c8-9912-c0d8ece283b6" containerID="8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc" exitCode=0
Sep 16 14:27:59.094008 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.093797    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"
Sep 16 14:27:59.094144 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.093816    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq" event={"ID":"bb0d4fd0-1987-42c8-9912-c0d8ece283b6","Type":"ContainerDied","Data":"8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc"}
Sep 16 14:27:59.094214 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.094133    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq" event={"ID":"bb0d4fd0-1987-42c8-9912-c0d8ece283b6","Type":"ContainerDied","Data":"f309f2aea20a3f96a1c18d5f615b7b79a2504d718431a304152be1eb4eb3647e"}
Sep 16 14:27:59.094214 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.094184    2582 scope.go:117] "RemoveContainer" containerID="8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc"
Sep 16 14:27:59.102639 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.102608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:59.108995 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.108974    2582 scope.go:117] "RemoveContainer" containerID="8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc"
Sep 16 14:27:59.109468 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:27:59.109447    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc\": container with ID starting with 8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc not found: ID does not exist" containerID="8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc"
Sep 16 14:27:59.109569 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.109475    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc"} err="failed to get container status \"8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc\": rpc error: code = NotFound desc = could not find container \"8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc\": container with ID starting with 8781b8b4d426822e6087fea44d1a8f0532f81363c275628ba5476f55543049fc not found: ID does not exist"
Sep 16 14:27:59.123651 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.123501    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"]
Sep 16 14:27:59.126349 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.126318    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1e4514fd-687b678f7b-zvpbq"]
Sep 16 14:27:59.180330 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.180303    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb0d4fd0-1987-42c8-9912-c0d8ece283b6" path="/var/lib/kubelet/pods/bb0d4fd0-1987-42c8-9912-c0d8ece283b6/volumes"
Sep 16 14:27:59.214054 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.214029    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:59.523397 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.523354    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:59.605644 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.605608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:27:59.701792 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:27:59.701765    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:00.215370 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:00.215340    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:00.928409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:00.928380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:01.910325 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:01.910291    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:02.429536 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:02.429498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:02.536023 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:02.535990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:02.823090 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:02.823051    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:03.420826 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.420795    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:28:03.691916 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.691818    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"]
Sep 16 14:28:03.692445 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.692424    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0d4fd0-1987-42c8-9912-c0d8ece283b6" containerName="maas-api"
Sep 16 14:28:03.692503 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.692449    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0d4fd0-1987-42c8-9912-c0d8ece283b6" containerName="maas-api"
Sep 16 14:28:03.692595 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.692581    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb0d4fd0-1987-42c8-9912-c0d8ece283b6" containerName="maas-api"
Sep 16 14:28:03.697501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.697482    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:03.700492 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.700472    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-7cfdb2ad-serving-cert\""
Sep 16 14:28:03.712140 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.712116    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"]
Sep 16 14:28:03.739417 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.739393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:03.845083 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.844842    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:03.852645 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.852608    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc119a33-afd0-493c-82a4-96baab74d191-metrics-certs\") pod \"maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:03.852998 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.852974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc119a33-afd0-493c-82a4-96baab74d191-openshift-service-ca\") pod \"maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:03.853202 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.853182    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc119a33-afd0-493c-82a4-96baab74d191-maas-api-tls\") pod \"maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:03.853417 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.853383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpwqg\" (UniqueName: \"kubernetes.io/projected/bc119a33-afd0-493c-82a4-96baab74d191-kube-api-access-rpwqg\") pod \"maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:03.954362 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.954280    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc119a33-afd0-493c-82a4-96baab74d191-maas-api-tls\") pod \"maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:03.954362 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.954318    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpwqg\" (UniqueName: \"kubernetes.io/projected/bc119a33-afd0-493c-82a4-96baab74d191-kube-api-access-rpwqg\") pod \"maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:03.954362 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.954359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc119a33-afd0-493c-82a4-96baab74d191-metrics-certs\") pod \"maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:03.954632 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.954404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc119a33-afd0-493c-82a4-96baab74d191-openshift-service-ca\") pod \"maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:03.955068 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.955045    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc119a33-afd0-493c-82a4-96baab74d191-openshift-service-ca\") pod \"maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:03.956884 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.956865    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc119a33-afd0-493c-82a4-96baab74d191-metrics-certs\") pod \"maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:03.956984 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.956915    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc119a33-afd0-493c-82a4-96baab74d191-maas-api-tls\") pod \"maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:03.962968 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:03.962945    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpwqg\" (UniqueName: \"kubernetes.io/projected/bc119a33-afd0-493c-82a4-96baab74d191-kube-api-access-rpwqg\") pod \"maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:04.008248 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:04.008199    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:04.295223 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:04.295192    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"]
Sep 16 14:28:04.347550 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:04.347513    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:04.446006 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:04.445968    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:04.686451 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:04.686428    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:04.831979 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:04.831948    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:05.136186 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:05.136150    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p" event={"ID":"bc119a33-afd0-493c-82a4-96baab74d191","Type":"ContainerStarted","Data":"272f3747b40e3aaa89e4725bd7032fe4fb9ab15ff133492ea41530e6b39ea4a1"}
Sep 16 14:28:05.136404 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:05.136201    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p" event={"ID":"bc119a33-afd0-493c-82a4-96baab74d191","Type":"ContainerStarted","Data":"c264a532dc0fc511933980c900373530b38c4df8c147ca55ec2be3e26de80e1e"}
Sep 16 14:28:05.136404 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:05.136360    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:05.159299 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:05.159216    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p" podStartSLOduration=1.782560076 podStartE2EDuration="2.159194649s" totalImagesPullingTime="376.634573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:28:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:28:05.156392384 +0000 UTC m=+804.450080864" watchObservedRunningTime="2026-09-16 14:28:05.159194649 +0000 UTC m=+804.452883128"
Sep 16 14:28:05.727034 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:05.726999    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:06.559810 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:06.559750    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:07.513444 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:07.513414    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:08.127198 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:08.127164    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:08.971394 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:08.971359    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:09.718152 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:09.718119    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:10.446089 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:10.446052    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:11.147497 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:11.147467    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:17.482942 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:17.482906    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:24.773988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:24.773954    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:25.165124 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:25.165085    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:28:26.767593 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:26.767558    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:27.895010 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:27.894965    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:28.857416 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:28.857383    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:29.728028 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:29.727998    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:30.727304 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:30.727262    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:31.438490 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:31.438454    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:32.232956 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:32.232921    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:32.898543 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:32.898512    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:33.575017 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:33.574975    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:34.180665 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.180631    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"]
Sep 16 14:28:34.181097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.180880    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p" podUID="bc119a33-afd0-493c-82a4-96baab74d191" containerName="maas-api" containerID="cri-o://272f3747b40e3aaa89e4725bd7032fe4fb9ab15ff133492ea41530e6b39ea4a1" gracePeriod=30
Sep 16 14:28:34.222274 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.222247    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:34.304090 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.304063    2582 generic.go:356] "Generic (PLEG): container finished" podID="bc119a33-afd0-493c-82a4-96baab74d191" containerID="272f3747b40e3aaa89e4725bd7032fe4fb9ab15ff133492ea41530e6b39ea4a1" exitCode=0
Sep 16 14:28:34.304221 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.304100    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p" event={"ID":"bc119a33-afd0-493c-82a4-96baab74d191","Type":"ContainerDied","Data":"272f3747b40e3aaa89e4725bd7032fe4fb9ab15ff133492ea41530e6b39ea4a1"}
Sep 16 14:28:34.397709 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.397678    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:34.426001 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.425979    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:34.520126 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.520056    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpwqg\" (UniqueName: \"kubernetes.io/projected/bc119a33-afd0-493c-82a4-96baab74d191-kube-api-access-rpwqg\") pod \"bc119a33-afd0-493c-82a4-96baab74d191\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") "
Sep 16 14:28:34.520126 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.520112    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc119a33-afd0-493c-82a4-96baab74d191-metrics-certs\") pod \"bc119a33-afd0-493c-82a4-96baab74d191\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") "
Sep 16 14:28:34.520353 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.520175    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc119a33-afd0-493c-82a4-96baab74d191-maas-api-tls\") pod \"bc119a33-afd0-493c-82a4-96baab74d191\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") "
Sep 16 14:28:34.520353 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.520215    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc119a33-afd0-493c-82a4-96baab74d191-openshift-service-ca\") pod \"bc119a33-afd0-493c-82a4-96baab74d191\" (UID: \"bc119a33-afd0-493c-82a4-96baab74d191\") "
Sep 16 14:28:34.520770 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.520719    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc119a33-afd0-493c-82a4-96baab74d191-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc119a33-afd0-493c-82a4-96baab74d191" (UID: "bc119a33-afd0-493c-82a4-96baab74d191"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:28:34.522375 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.522351    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc119a33-afd0-493c-82a4-96baab74d191-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bc119a33-afd0-493c-82a4-96baab74d191" (UID: "bc119a33-afd0-493c-82a4-96baab74d191"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:28:34.522478 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.522370    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc119a33-afd0-493c-82a4-96baab74d191-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc119a33-afd0-493c-82a4-96baab74d191" (UID: "bc119a33-afd0-493c-82a4-96baab74d191"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:28:34.522478 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.522404    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc119a33-afd0-493c-82a4-96baab74d191-kube-api-access-rpwqg" (OuterVolumeSpecName: "kube-api-access-rpwqg") pod "bc119a33-afd0-493c-82a4-96baab74d191" (UID: "bc119a33-afd0-493c-82a4-96baab74d191"). InnerVolumeSpecName "kube-api-access-rpwqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:28:34.584399 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.582384    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:34.621058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.621026    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpwqg\" (UniqueName: \"kubernetes.io/projected/bc119a33-afd0-493c-82a4-96baab74d191-kube-api-access-rpwqg\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:28:34.621058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.621052    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc119a33-afd0-493c-82a4-96baab74d191-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:28:34.621058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.621061    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc119a33-afd0-493c-82a4-96baab74d191-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:28:34.621293 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.621069    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc119a33-afd0-493c-82a4-96baab74d191-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:28:34.718954 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.718923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:34.993482 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:34.993438    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:35.175067 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.175034    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:35.311525 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.311495    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"
Sep 16 14:28:35.311930 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.311496    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p" event={"ID":"bc119a33-afd0-493c-82a4-96baab74d191","Type":"ContainerDied","Data":"c264a532dc0fc511933980c900373530b38c4df8c147ca55ec2be3e26de80e1e"}
Sep 16 14:28:35.311930 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.311637    2582 scope.go:117] "RemoveContainer" containerID="272f3747b40e3aaa89e4725bd7032fe4fb9ab15ff133492ea41530e6b39ea4a1"
Sep 16 14:28:35.338091 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.338061    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"]
Sep 16 14:28:35.345474 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.345447    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7cfdb2ad-64d7c8f6d4-bkt2p"]
Sep 16 14:28:35.411815 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.411786    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"]
Sep 16 14:28:35.412188 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.412176    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc119a33-afd0-493c-82a4-96baab74d191" containerName="maas-api"
Sep 16 14:28:35.412255 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.412189    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc119a33-afd0-493c-82a4-96baab74d191" containerName="maas-api"
Sep 16 14:28:35.412300 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.412278    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc119a33-afd0-493c-82a4-96baab74d191" containerName="maas-api"
Sep 16 14:28:35.416733 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.416716    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.419626 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.419606    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5317692d-openshift-default-dockercfg-9q67m\""
Sep 16 14:28:35.433364 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.433340    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"]
Sep 16 14:28:35.486441 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.486401    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:35.529783 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.529746    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-workload-socket\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.530005 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.529800    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-envoy\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.530005 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.529833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-token\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.530005 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.529931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-data\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.530195 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.530018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-workload-certs\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.530195 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.530086    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2p58\" (UniqueName: \"kubernetes.io/projected/23c699ab-20f9-49a1-866b-a51ef108b4e7-kube-api-access-j2p58\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.530195 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.530130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-podinfo\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.530195 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.530176    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-credential-socket\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.530440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.530220    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c699ab-20f9-49a1-866b-a51ef108b4e7-istiod-ca-cert\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.631782 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.631667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-envoy\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.631962 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.631926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-token\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.632046 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.631979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-data\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.632107 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.632095    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-workload-certs\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.632183 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.632165    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2p58\" (UniqueName: \"kubernetes.io/projected/23c699ab-20f9-49a1-866b-a51ef108b4e7-kube-api-access-j2p58\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.632267 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.632225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-podinfo\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.632331 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.632293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-credential-socket\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.632392 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.632339    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c699ab-20f9-49a1-866b-a51ef108b4e7-istiod-ca-cert\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.632446 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.632431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-workload-socket\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.632967 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.632931    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-workload-certs\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.633099 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.633000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-data\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.633265 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.633218    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-credential-socket\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.633618 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.633589    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-workload-socket\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.633741 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.633693    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c699ab-20f9-49a1-866b-a51ef108b4e7-istiod-ca-cert\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.635450 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.635422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-envoy\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.636664 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.636629    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-podinfo\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.649728 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.649705    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2p58\" (UniqueName: \"kubernetes.io/projected/23c699ab-20f9-49a1-866b-a51ef108b4e7-kube-api-access-j2p58\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.651064 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.651047    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-token\") pod \"e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") " pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.726141 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.726117    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:35.797097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:35.797066    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:36.019343 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:36.019317    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"]
Sep 16 14:28:36.020332 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:28:36.020291    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c699ab_20f9_49a1_866b_a51ef108b4e7.slice/crio-558cee6524686b6d5ed61d73710adac1747059a6e7ca1bd6b770e05d337e83d1 WatchSource:0}: Error finding container 558cee6524686b6d5ed61d73710adac1747059a6e7ca1bd6b770e05d337e83d1: Status 404 returned error can't find the container with id 558cee6524686b6d5ed61d73710adac1747059a6e7ca1bd6b770e05d337e83d1
Sep 16 14:28:36.022800 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:36.022769    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:28:36.022897 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:36.022846    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:28:36.022897 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:36.022886    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:28:36.046452 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:36.046426    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:36.320548 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:36.320516    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" event={"ID":"23c699ab-20f9-49a1-866b-a51ef108b4e7","Type":"ContainerStarted","Data":"9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790"}
Sep 16 14:28:36.320909 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:36.320564    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" event={"ID":"23c699ab-20f9-49a1-866b-a51ef108b4e7","Type":"ContainerStarted","Data":"558cee6524686b6d5ed61d73710adac1747059a6e7ca1bd6b770e05d337e83d1"}
Sep 16 14:28:36.353127 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:36.353079    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" podStartSLOduration=1.353066205 podStartE2EDuration="1.353066205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:28:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:28:36.351005199 +0000 UTC m=+835.644693677" watchObservedRunningTime="2026-09-16 14:28:36.353066205 +0000 UTC m=+835.646754683"
Sep 16 14:28:36.727095 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:36.727016    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:36.766077 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:36.766043    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:37.181078 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:37.181048    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc119a33-afd0-493c-82a4-96baab74d191" path="/var/lib/kubelet/pods/bc119a33-afd0-493c-82a4-96baab74d191/volumes"
Sep 16 14:28:37.731475 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:37.731446    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:37.909699 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:37.909666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:38.038709 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:38.038648    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:38.332196 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:38.332120    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:38.333022 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:38.333007    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:28:39.223659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:39.223613    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:40.398746 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:40.398711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:41.469470 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:41.469439    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:41.569159 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:41.569079    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:41.938154 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:41.938076    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:42.066926 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:42.066898    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:42.246474 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:42.246387    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:28:42.524229 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:42.524152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:43.374178 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:43.374145    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:43.813262 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:43.813210    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:44.247441 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:44.247346    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:28:45.027072 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:28:45.027038    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:01.354173 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:01.354101    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:01.469557 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:01.469472    2582 generic.go:356] "Generic (PLEG): container finished" podID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerID="9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790" exitCode=0
Sep 16 14:29:01.469721 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:01.469551    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" event={"ID":"23c699ab-20f9-49a1-866b-a51ef108b4e7","Type":"ContainerDied","Data":"9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790"}
Sep 16 14:29:01.470069 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:01.470050    2582 scope.go:117] "RemoveContainer" containerID="9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790"
Sep 16 14:29:01.471360 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:01.471334    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:29:01.471429 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:01.471402    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:29:01.471468 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:01.471433    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:29:02.449888 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:02.449862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:02.477639 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:02.477605    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" event={"ID":"23c699ab-20f9-49a1-866b-a51ef108b4e7","Type":"ContainerStarted","Data":"9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d"}
Sep 16 14:29:02.726380 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:02.726287    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:29:02.726597 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:02.726576    2582 patch_prober.go:28] interesting pod/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:29:02.726643 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:02.726624    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 14:29:03.329010 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:03.328976    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:29:03.727302 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:03.727215    2582 patch_prober.go:28] interesting pod/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:29:03.727652 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:03.727296    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 14:29:03.958462 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:03.958428    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:04.627055 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:04.627023    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:04.726702 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:04.726668    2582 patch_prober.go:28] interesting pod/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:29:04.726868 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:04.726721    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 14:29:05.328677 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:05.328643    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:05.727464 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:05.727375    2582 patch_prober.go:28] interesting pod/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:29:05.727464 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:05.727431    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 14:29:06.079953 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:06.079917    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:06.726909 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:06.726868    2582 patch_prober.go:28] interesting pod/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:29:06.727317 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:06.726936    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 14:29:07.017456 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:07.017355    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:07.726926 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:07.726883    2582 patch_prober.go:28] interesting pod/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:29:07.727437 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:07.726960    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 14:29:07.990641 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:07.990549    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:08.332418 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:08.332372    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:29:08.731907 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:08.731825    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:29:08.732926 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:08.732905    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:29:08.892840 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:08.892805    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:09.662378 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:09.662338    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:10.707497 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:10.707460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:11.550138 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:11.550105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:12.643827 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:12.643797    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:13.447933 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:13.447899    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:14.284655 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:14.284613    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:15.538458 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:15.538418    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:17.722346 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:17.722308    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:19.113994 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:19.113954    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:20.022715 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:20.022677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:21.188188 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:21.188151    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:22.014494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:22.014451    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:22.202635 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:22.202602    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:22.506378 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:22.506341    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:22.631726 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:22.631694    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:23.727634 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:23.727605    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"]
Sep 16 14:29:23.728081 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:23.727801    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy" containerID="cri-o://9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d" gracePeriod=30
Sep 16 14:29:23.733985 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:23.733956    2582 patch_prober.go:28] interesting pod/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 16 14:29:23.734118 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:23.734005    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:29:23.744670 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:23.744645    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:23.853596 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:23.853555    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:24.200424 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:24.200369    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:24.349911 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:24.349873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:24.634274 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:24.634140    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:24.909390 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:24.909312    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:25.333908 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:25.333863    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:26.257642 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:26.257605    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:26.897600 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:26.897572    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:27.144132 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:27.144099    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:28.047436 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:28.047401    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:28.839014 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:28.838981    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:28.992737 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:28.992677    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:29:29.041569 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.041533    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-token\") pod \"23c699ab-20f9-49a1-866b-a51ef108b4e7\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") "
Sep 16 14:29:29.041744 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.041580    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-podinfo\") pod \"23c699ab-20f9-49a1-866b-a51ef108b4e7\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") "
Sep 16 14:29:29.041744 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.041618    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-workload-certs\") pod \"23c699ab-20f9-49a1-866b-a51ef108b4e7\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") "
Sep 16 14:29:29.041744 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.041637    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-envoy\") pod \"23c699ab-20f9-49a1-866b-a51ef108b4e7\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") "
Sep 16 14:29:29.041744 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.041687    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-data\") pod \"23c699ab-20f9-49a1-866b-a51ef108b4e7\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") "
Sep 16 14:29:29.041744 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.041727    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2p58\" (UniqueName: \"kubernetes.io/projected/23c699ab-20f9-49a1-866b-a51ef108b4e7-kube-api-access-j2p58\") pod \"23c699ab-20f9-49a1-866b-a51ef108b4e7\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") "
Sep 16 14:29:29.042046 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.041803    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-credential-socket\") pod \"23c699ab-20f9-49a1-866b-a51ef108b4e7\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") "
Sep 16 14:29:29.042046 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.041851    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-workload-socket\") pod \"23c699ab-20f9-49a1-866b-a51ef108b4e7\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") "
Sep 16 14:29:29.042046 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.041875    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c699ab-20f9-49a1-866b-a51ef108b4e7-istiod-ca-cert\") pod \"23c699ab-20f9-49a1-866b-a51ef108b4e7\" (UID: \"23c699ab-20f9-49a1-866b-a51ef108b4e7\") "
Sep 16 14:29:29.042046 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.041930    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "23c699ab-20f9-49a1-866b-a51ef108b4e7" (UID: "23c699ab-20f9-49a1-866b-a51ef108b4e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:29:29.042046 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.041956    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "23c699ab-20f9-49a1-866b-a51ef108b4e7" (UID: "23c699ab-20f9-49a1-866b-a51ef108b4e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:29:29.042343 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.042128    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "23c699ab-20f9-49a1-866b-a51ef108b4e7" (UID: "23c699ab-20f9-49a1-866b-a51ef108b4e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:29:29.042343 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.042168    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "23c699ab-20f9-49a1-866b-a51ef108b4e7" (UID: "23c699ab-20f9-49a1-866b-a51ef108b4e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:29:29.042461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.042345    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-workload-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:29.042461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.042364    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-data\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:29.042461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.042378    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-credential-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:29.042461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.042390    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-workload-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:29.042461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.042447    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23c699ab-20f9-49a1-866b-a51ef108b4e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "23c699ab-20f9-49a1-866b-a51ef108b4e7" (UID: "23c699ab-20f9-49a1-866b-a51ef108b4e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:29:29.043956 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.043927    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "23c699ab-20f9-49a1-866b-a51ef108b4e7" (UID: "23c699ab-20f9-49a1-866b-a51ef108b4e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:29:29.044072 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.044012    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c699ab-20f9-49a1-866b-a51ef108b4e7-kube-api-access-j2p58" (OuterVolumeSpecName: "kube-api-access-j2p58") pod "23c699ab-20f9-49a1-866b-a51ef108b4e7" (UID: "23c699ab-20f9-49a1-866b-a51ef108b4e7"). InnerVolumeSpecName "kube-api-access-j2p58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:29:29.044428 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.044402    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "23c699ab-20f9-49a1-866b-a51ef108b4e7" (UID: "23c699ab-20f9-49a1-866b-a51ef108b4e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:29:29.044428 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.044416    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "23c699ab-20f9-49a1-866b-a51ef108b4e7" (UID: "23c699ab-20f9-49a1-866b-a51ef108b4e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:29:29.123923 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.123882    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:29.142893 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.142860    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c699ab-20f9-49a1-866b-a51ef108b4e7-istiod-ca-cert\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:29.142893 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.142888    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-token\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:29.143059 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.142902    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-podinfo\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:29.143059 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.142914    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c699ab-20f9-49a1-866b-a51ef108b4e7-istio-envoy\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:29.143059 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.142928    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2p58\" (UniqueName: \"kubernetes.io/projected/23c699ab-20f9-49a1-866b-a51ef108b4e7-kube-api-access-j2p58\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:29.320959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.320921    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:29.484339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.484300    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:29.638716 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.638631    2582 generic.go:356] "Generic (PLEG): container finished" podID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerID="9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d" exitCode=0
Sep 16 14:29:29.638716 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.638678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" event={"ID":"23c699ab-20f9-49a1-866b-a51ef108b4e7","Type":"ContainerDied","Data":"9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d"}
Sep 16 14:29:29.638716 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.638676    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"
Sep 16 14:29:29.639105 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.638725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz" event={"ID":"23c699ab-20f9-49a1-866b-a51ef108b4e7","Type":"ContainerDied","Data":"558cee6524686b6d5ed61d73710adac1747059a6e7ca1bd6b770e05d337e83d1"}
Sep 16 14:29:29.639105 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.638747    2582 scope.go:117] "RemoveContainer" containerID="9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d"
Sep 16 14:29:29.648760 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.648740    2582 scope.go:117] "RemoveContainer" containerID="9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790"
Sep 16 14:29:29.657743 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.657720    2582 scope.go:117] "RemoveContainer" containerID="9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d"
Sep 16 14:29:29.658110 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:29:29.658089    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d\": container with ID starting with 9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d not found: ID does not exist" containerID="9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d"
Sep 16 14:29:29.658202 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.658122    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d"} err="failed to get container status \"9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d\": rpc error: code = NotFound desc = could not find container \"9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d\": container with ID starting with 9d050026280a60bb464750ce1b8817ca629d1aa753c8190efed65375ef47512d not found: ID does not exist"
Sep 16 14:29:29.658202 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.658148    2582 scope.go:117] "RemoveContainer" containerID="9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790"
Sep 16 14:29:29.658473 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:29:29.658452    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790\": container with ID starting with 9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790 not found: ID does not exist" containerID="9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790"
Sep 16 14:29:29.658542 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.658478    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790"} err="failed to get container status \"9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790\": rpc error: code = NotFound desc = could not find container \"9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790\": container with ID starting with 9ccc56812fd20f5975280d7324083e9b00acf89b8ee0499c7b81edf16b8b0790 not found: ID does not exist"
Sep 16 14:29:29.660802 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.660780    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"]
Sep 16 14:29:29.666282 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.666261    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz"]
Sep 16 14:29:29.771070 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.771039    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"]
Sep 16 14:29:29.771304 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.771278    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc" podUID="cba4000e-060c-4e5f-9384-c43228366a87" containerName="maas-api" containerID="cri-o://25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d" gracePeriod=30
Sep 16 14:29:29.893163 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:29.893123    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:30.020656 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.020626    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:29:30.100967 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.100937    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:30.152281 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.152188    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba4000e-060c-4e5f-9384-c43228366a87-openshift-service-ca\") pod \"cba4000e-060c-4e5f-9384-c43228366a87\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") "
Sep 16 14:29:30.152704 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.152279    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-metrics-certs\") pod \"cba4000e-060c-4e5f-9384-c43228366a87\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") "
Sep 16 14:29:30.152704 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.152332    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-maas-api-tls\") pod \"cba4000e-060c-4e5f-9384-c43228366a87\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") "
Sep 16 14:29:30.152704 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.152377    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f2h9\" (UniqueName: \"kubernetes.io/projected/cba4000e-060c-4e5f-9384-c43228366a87-kube-api-access-6f2h9\") pod \"cba4000e-060c-4e5f-9384-c43228366a87\" (UID: \"cba4000e-060c-4e5f-9384-c43228366a87\") "
Sep 16 14:29:30.152704 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.152543    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cba4000e-060c-4e5f-9384-c43228366a87-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cba4000e-060c-4e5f-9384-c43228366a87" (UID: "cba4000e-060c-4e5f-9384-c43228366a87"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:29:30.154457 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.154425    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cba4000e-060c-4e5f-9384-c43228366a87-kube-api-access-6f2h9" (OuterVolumeSpecName: "kube-api-access-6f2h9") pod "cba4000e-060c-4e5f-9384-c43228366a87" (UID: "cba4000e-060c-4e5f-9384-c43228366a87"). InnerVolumeSpecName "kube-api-access-6f2h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:29:30.154457 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.154427    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cba4000e-060c-4e5f-9384-c43228366a87" (UID: "cba4000e-060c-4e5f-9384-c43228366a87"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:29:30.154591 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.154509    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cba4000e-060c-4e5f-9384-c43228366a87" (UID: "cba4000e-060c-4e5f-9384-c43228366a87"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:29:30.253058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.253025    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:30.253058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.253053    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f2h9\" (UniqueName: \"kubernetes.io/projected/cba4000e-060c-4e5f-9384-c43228366a87-kube-api-access-6f2h9\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:30.253058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.253064    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba4000e-060c-4e5f-9384-c43228366a87-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:30.253329 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.253072    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cba4000e-060c-4e5f-9384-c43228366a87-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:29:30.294734 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.294703    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:30.427500 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.427410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:30.526450 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.526414    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:29:30.646390 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.646354    2582 generic.go:356] "Generic (PLEG): container finished" podID="cba4000e-060c-4e5f-9384-c43228366a87" containerID="25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d" exitCode=0
Sep 16 14:29:30.646566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.646404    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"
Sep 16 14:29:30.646566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.646435    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc" event={"ID":"cba4000e-060c-4e5f-9384-c43228366a87","Type":"ContainerDied","Data":"25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d"}
Sep 16 14:29:30.646566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.646487    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc" event={"ID":"cba4000e-060c-4e5f-9384-c43228366a87","Type":"ContainerDied","Data":"826eeb718b2723fd05f6c2a098d617496cdd2fed0bf81b56bf841554e95410ee"}
Sep 16 14:29:30.646566 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.646515    2582 scope.go:117] "RemoveContainer" containerID="25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d"
Sep 16 14:29:30.656177 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.656158    2582 scope.go:117] "RemoveContainer" containerID="25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d"
Sep 16 14:29:30.656476 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:29:30.656458    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d\": container with ID starting with 25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d not found: ID does not exist" containerID="25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d"
Sep 16 14:29:30.656542 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.656483    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d"} err="failed to get container status \"25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d\": rpc error: code = NotFound desc = could not find container \"25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d\": container with ID starting with 25e33c7b4ba6b9b5e56c2a865a8c1055720b5e7ca4f434d56f9fd90a596fed1d not found: ID does not exist"
Sep 16 14:29:30.688177 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.688117    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"]
Sep 16 14:29:30.696965 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.696943    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-84fdff-67f8c945c-hk2sc"]
Sep 16 14:29:30.867190 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:30.867158    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:31.182662 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:31.182623    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" path="/var/lib/kubelet/pods/23c699ab-20f9-49a1-866b-a51ef108b4e7/volumes"
Sep 16 14:29:31.183185 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:31.183167    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cba4000e-060c-4e5f-9384-c43228366a87" path="/var/lib/kubelet/pods/cba4000e-060c-4e5f-9384-c43228366a87/volumes"
Sep 16 14:29:31.592473 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:31.592435    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:32.277139 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:32.277112    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:33.026755 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:33.026722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:33.716686 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:33.716604    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:34.455090 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:34.455031    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:35.243414 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:35.243377    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:35.534318 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:35.534182    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:36.482543 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:36.482504    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:36.654102 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:36.654066    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:50.024470 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:50.024435    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:51.606782 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:51.606670    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:52.539475 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:52.539434    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:53.320483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:53.320446    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:29:53.460401 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:53.460368    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:54.199702 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:54.199630    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:54.882395 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:54.882362    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:55.630015 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:55.629983    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:57.082196 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:57.082167    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:58.250723 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:58.250688    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:58.851717 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:58.851676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:58.947628 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:58.947593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:59.025714 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:59.025685    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:59.169256 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:59.169160    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:59.438267 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:59.438157    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:59.895824 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:59.895780    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:29:59.986062 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:29:59.986028    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:00.087460 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:00.087423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:00.603348 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:00.603309    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:01.537046 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:01.537018    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:01.637300 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:01.637265    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:02.268038 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:02.268006    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:02.370963 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:02.370929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:03.229114 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:03.229080    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:07.738297 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:07.738255    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:07.863024 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:07.862988    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:07.963430 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:07.963398    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:08.121599 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:08.121563    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:30:08.424279 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:08.424140    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:12.354211 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:12.354181    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:12.595045 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:12.595014    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:13.120745 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.120711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:13.505107 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.505035    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"]
Sep 16 14:30:13.505460 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.505444    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cba4000e-060c-4e5f-9384-c43228366a87" containerName="maas-api"
Sep 16 14:30:13.505460 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.505458    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cba4000e-060c-4e5f-9384-c43228366a87" containerName="maas-api"
Sep 16 14:30:13.505538 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.505478    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy"
Sep 16 14:30:13.505538 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.505486    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy"
Sep 16 14:30:13.505538 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.505499    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy"
Sep 16 14:30:13.505538 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.505505    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy"
Sep 16 14:30:13.505659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.505570    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cba4000e-060c-4e5f-9384-c43228366a87" containerName="maas-api"
Sep 16 14:30:13.505659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.505581    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy"
Sep 16 14:30:13.505659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.505587    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="23c699ab-20f9-49a1-866b-a51ef108b4e7" containerName="istio-proxy"
Sep 16 14:30:13.508507 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.508488    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.512051 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.512033    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-7ce904-openshift-default-dockercfg-h9pzq\""
Sep 16 14:30:13.529422 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.529397    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"]
Sep 16 14:30:13.642251 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.642205    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-workload-certs\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.642446 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.642275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-workload-socket\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.642446 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.642294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-podinfo\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.642446 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.642333    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr7xw\" (UniqueName: \"kubernetes.io/projected/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-kube-api-access-dr7xw\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.642446 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.642409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-credential-socket\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.642765 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.642492    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-envoy\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.642765 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.642541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-token\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.642765 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.642601    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istiod-ca-cert\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.642765 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.642637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-data\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743107 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr7xw\" (UniqueName: \"kubernetes.io/projected/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-kube-api-access-dr7xw\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743338 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-credential-socket\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743338 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-envoy\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743338 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-token\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743338 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istiod-ca-cert\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743338 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-data\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743618 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-workload-certs\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743618 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743533    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-workload-socket\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743618 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743558    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-podinfo\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743768 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743620    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-credential-socket\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743851 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743828    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-data\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743909 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743853    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-workload-certs\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.743909 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.743898    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-workload-socket\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.744072 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.744053    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istiod-ca-cert\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.745556 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.745532    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-envoy\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.745869 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.745852    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-podinfo\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.755958 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.755897    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr7xw\" (UniqueName: \"kubernetes.io/projected/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-kube-api-access-dr7xw\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.757516 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.757496    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-token\") pod \"e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") " pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.820020 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.819998    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:13.957060 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:13.957028    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:14.108770 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:14.108744    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"]
Sep 16 14:30:14.110605 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:30:14.110584    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2b23fa_8612_4aca_b5e0_ae8c2ba3b263.slice/crio-a899259b40bb0eb58bb2a945612ca234627fbf7cca218991450f930375434bf2 WatchSource:0}: Error finding container a899259b40bb0eb58bb2a945612ca234627fbf7cca218991450f930375434bf2: Status 404 returned error can't find the container with id a899259b40bb0eb58bb2a945612ca234627fbf7cca218991450f930375434bf2
Sep 16 14:30:14.112815 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:14.112781    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:30:14.112879 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:14.112850    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:30:14.112956 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:14.112880    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:30:14.238886 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:14.238849    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:14.894559 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:14.894528    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" event={"ID":"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263","Type":"ContainerStarted","Data":"1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff"}
Sep 16 14:30:14.894915 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:14.894576    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" event={"ID":"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263","Type":"ContainerStarted","Data":"a899259b40bb0eb58bb2a945612ca234627fbf7cca218991450f930375434bf2"}
Sep 16 14:30:14.922274 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:14.922223    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" podStartSLOduration=1.922207199 podStartE2EDuration="1.922207199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:30:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:30:14.91951261 +0000 UTC m=+934.213201089" watchObservedRunningTime="2026-09-16 14:30:14.922207199 +0000 UTC m=+934.215895677"
Sep 16 14:30:15.820846 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:15.820807    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:15.825751 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:15.825726    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:15.900213 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:15.900182    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:15.901582 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:15.901562    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:16.326920 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:16.326885    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:16.958396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:16.958366    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:17.057221 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:17.057191    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:17.271577 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:17.271452    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:18.040584 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:18.040552    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:18.797203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:18.797170    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:19.646009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:19.645973    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:20.429648 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:20.429597    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:20.565943 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:20.565909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:20.773023 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:20.772929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:21.276885 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:21.276836    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:21.362517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:21.362480    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:28.428205 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:28.428170    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:30:32.030341 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:32.030307    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:34.764507 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:34.764472    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:39.044659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:39.044621    2582 generic.go:356] "Generic (PLEG): container finished" podID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerID="1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff" exitCode=0
Sep 16 14:30:39.045165 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:39.044684    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" event={"ID":"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263","Type":"ContainerDied","Data":"1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff"}
Sep 16 14:30:39.045231 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:39.045216    2582 scope.go:117] "RemoveContainer" containerID="1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff"
Sep 16 14:30:39.046681 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:39.046642    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:30:39.046761 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:39.046744    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:30:39.046811 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:39.046795    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:30:40.052301 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:40.052266    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" event={"ID":"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263","Type":"ContainerStarted","Data":"80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98"}
Sep 16 14:30:40.141995 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:40.141964    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:40.254565 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:40.254531    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:40.820866 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:40.820831    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:40.821055 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:40.821019    2582 patch_prober.go:28] interesting pod/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 16 14:30:40.821108 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:40.821069    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 16 14:30:41.007022 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:41.006992    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:41.820635 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:41.820601    2582 patch_prober.go:28] interesting pod/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 16 14:30:41.821031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:41.820659    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 16 14:30:42.321122 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:42.321086    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:42.820436 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:42.820399    2582 patch_prober.go:28] interesting pod/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 16 14:30:42.820606 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:42.820464    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 16 14:30:43.821407 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:43.821368    2582 patch_prober.go:28] interesting pod/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 16 14:30:43.821860 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:43.821430    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 16 14:30:43.951379 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:43.951344    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:44.328547 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:44.328494    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:44.820858 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:44.820817    2582 patch_prober.go:28] interesting pod/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 16 14:30:44.821027 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:44.820903    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 16 14:30:45.140669 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:45.140559    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:45.805498 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:45.805465    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:45.824735 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:45.824709    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:45.825103 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:45.825082    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:45.825813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:45.825797    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:30:46.459003 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:46.458968    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:47.178226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:47.178194    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:30:49.714715 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:49.714680    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:30:56.278979 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:30:56.278950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:02.870409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:02.870376    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:02.990657 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:02.990622    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:03.092391 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:03.092357    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:13.637561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:13.637526    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:14.480086 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:14.480047    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:20.480340 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:20.480305    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:21.554947 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:21.554911    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:21.771754 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:21.771718    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:22.438370 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:22.438333    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:22.568772 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:22.568723    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:22.745058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:22.744965    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:24.246605 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:24.246569    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:28.729736 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:28.729702    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:31:31.456066 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:31.456031    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:31.590924 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:31.590896    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:32.208102 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:32.208069    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:36.574285 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:36.574231    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:36.679941 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:36.679909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:39.018602 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:39.018567    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:39.115176 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:39.115141    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:43.017303 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.017221    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"]
Sep 16 14:31:43.019828 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.019813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.023177 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.023144    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-7ce904\"/\"openshift-service-ca.crt\""
Sep 16 14:31:43.023324 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.023278    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-7ce904\"/\"default-dockercfg-4mt9z\""
Sep 16 14:31:43.024143 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.024123    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-7ce904\"/\"kube-root-ca.crt\""
Sep 16 14:31:43.029270 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.029252    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-7ce904\"/\"explicit-model-7ce904-kserve-self-signed-certs\""
Sep 16 14:31:43.039418 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.039390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-dshm\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.039512 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.039444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df59576-cdc6-4a67-928e-f90c97914e6e-tls-certs\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.039512 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.039482    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl9cp\" (UniqueName: \"kubernetes.io/projected/9df59576-cdc6-4a67-928e-f90c97914e6e-kube-api-access-gl9cp\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.039615 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.039600    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-tmp-dir\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.039653 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.039627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-home\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.039751 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.039728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-model-cache\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.041020 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.041000    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"]
Sep 16 14:31:43.088515 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.088491    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:43.140168 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.140140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-dshm\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.140301 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.140181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df59576-cdc6-4a67-928e-f90c97914e6e-tls-certs\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.140301 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.140211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl9cp\" (UniqueName: \"kubernetes.io/projected/9df59576-cdc6-4a67-928e-f90c97914e6e-kube-api-access-gl9cp\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.140410 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.140320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-tmp-dir\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.140410 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.140344    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-home\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.140410 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.140404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-model-cache\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.140696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.140671    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-tmp-dir\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.140777 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.140717    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-home\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.140821 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.140786    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-model-cache\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.142388 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.142372    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-dshm\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.142705 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.142689    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df59576-cdc6-4a67-928e-f90c97914e6e-tls-certs\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.151049 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.151031    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl9cp\" (UniqueName: \"kubernetes.io/projected/9df59576-cdc6-4a67-928e-f90c97914e6e-kube-api-access-gl9cp\") pod \"explicit-model-7ce904-kserve-5c46d94669-ldgwb\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") " pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.330335 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.330303    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:43.599871 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:43.599847    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"]
Sep 16 14:31:43.601589 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:31:43.601565    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9df59576_cdc6_4a67_928e_f90c97914e6e.slice/crio-ec6e6fb8afc658550262b26e7881640811fb2cdf7d86d68bfe4800a7ca1c8b05 WatchSource:0}: Error finding container ec6e6fb8afc658550262b26e7881640811fb2cdf7d86d68bfe4800a7ca1c8b05: Status 404 returned error can't find the container with id ec6e6fb8afc658550262b26e7881640811fb2cdf7d86d68bfe4800a7ca1c8b05
Sep 16 14:31:44.294193 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:44.294156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:44.405861 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:44.405824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb" event={"ID":"9df59576-cdc6-4a67-928e-f90c97914e6e","Type":"ContainerStarted","Data":"8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8"}
Sep 16 14:31:44.405996 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:44.405873    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb" event={"ID":"9df59576-cdc6-4a67-928e-f90c97914e6e","Type":"ContainerStarted","Data":"ec6e6fb8afc658550262b26e7881640811fb2cdf7d86d68bfe4800a7ca1c8b05"}
Sep 16 14:31:44.429942 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:44.429893    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb" podStartSLOduration=2.429877823 podStartE2EDuration="2.429877823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:31:44.427631732 +0000 UTC m=+1023.721320223" watchObservedRunningTime="2026-09-16 14:31:44.429877823 +0000 UTC m=+1023.723566301"
Sep 16 14:31:47.318091 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:47.318059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:50.013105 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:50.013060    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:31:50.054790 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:50.054746    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:53.330990 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:53.330960    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:53.331392 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:53.331173    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:53.343351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:53.343326    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:53.466331 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:53.466301    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:31:59.621413 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:59.621375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:31:59.787574 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:31:59.787543    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:00.810251 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:00.810204    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"]
Sep 16 14:32:00.820603 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:00.820577    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:01.855813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:01.855767    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:02.778808 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:02.778773    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:03.446081 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:03.446046    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:04.393759 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:04.393720    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:05.103750 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:05.103703    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:05.889344 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:05.889301    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:06.001592 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:06.001555    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:06.929017 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:06.928981    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:07.922962 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:07.922930    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:08.711764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:08.711711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:09.519739 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:09.519698    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:10.173279 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.173244    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"]
Sep 16 14:32:10.176448 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.176427    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.178819 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.178799    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5e366590-serving-cert\""
Sep 16 14:32:10.187903 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.187881    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"]
Sep 16 14:32:10.218522 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.218497    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:10.281724 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.281690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-metrics-certs\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.282159 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.282130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srnpw\" (UniqueName: \"kubernetes.io/projected/50841575-12ac-4052-84d5-5ba623df3325-kube-api-access-srnpw\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.282436 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.282416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50841575-12ac-4052-84d5-5ba623df3325-openshift-service-ca\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.282614 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.282597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-maas-api-tls\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.320477 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.320447    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:10.386905 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.386870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50841575-12ac-4052-84d5-5ba623df3325-openshift-service-ca\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.387078 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.386922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-maas-api-tls\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.387078 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.386982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-metrics-certs\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.387078 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.387001    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srnpw\" (UniqueName: \"kubernetes.io/projected/50841575-12ac-4052-84d5-5ba623df3325-kube-api-access-srnpw\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.387286 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:32:10.387092    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-serving-cert: secret "maas-api-e2e-mt-5e366590-serving-cert" not found
Sep 16 14:32:10.387286 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:32:10.387176    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-maas-api-tls podName:50841575-12ac-4052-84d5-5ba623df3325 nodeName:}" failed. No retries permitted until 2026-09-16 14:32:10.887158388 +0000 UTC m=+1050.180846849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-maas-api-tls") pod "maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj" (UID: "50841575-12ac-4052-84d5-5ba623df3325") : secret "maas-api-e2e-mt-5e366590-serving-cert" not found
Sep 16 14:32:10.387630 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.387610    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50841575-12ac-4052-84d5-5ba623df3325-openshift-service-ca\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.389570 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.389546    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-metrics-certs\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.396498 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.396467    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srnpw\" (UniqueName: \"kubernetes.io/projected/50841575-12ac-4052-84d5-5ba623df3325-kube-api-access-srnpw\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.470171 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.470105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:10.691175 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.691143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:10.745999 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.745927    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:32:10.784099 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.784073    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:10.892273 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.892208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-maas-api-tls\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:10.895265 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:10.895219    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-maas-api-tls\") pod \"maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:11.064507 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:11.064470    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:11.089459 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:11.089435    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:11.162088 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:11.161684    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:11.260652 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:11.260622    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:11.358576 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:11.358506    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:11.373195 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:11.373175    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"]
Sep 16 14:32:11.374650 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:32:11.374628    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50841575_12ac_4052_84d5_5ba623df3325.slice/crio-6f4029acfcab8dcc1bc730f25edd35cb43336abd247d4f101376e1d402de674c WatchSource:0}: Error finding container 6f4029acfcab8dcc1bc730f25edd35cb43336abd247d4f101376e1d402de674c: Status 404 returned error can't find the container with id 6f4029acfcab8dcc1bc730f25edd35cb43336abd247d4f101376e1d402de674c
Sep 16 14:32:11.375876 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:11.375858    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:32:11.560913 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:11.560875    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj" event={"ID":"50841575-12ac-4052-84d5-5ba623df3325","Type":"ContainerStarted","Data":"6f4029acfcab8dcc1bc730f25edd35cb43336abd247d4f101376e1d402de674c"}
Sep 16 14:32:11.837474 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:11.837441    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:12.287925 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:12.287878    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:12.568042 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:12.567950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj" event={"ID":"50841575-12ac-4052-84d5-5ba623df3325","Type":"ContainerStarted","Data":"27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd"}
Sep 16 14:32:12.568184 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:12.568104    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:12.587421 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:12.587375    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj" podStartSLOduration=2.094165144 podStartE2EDuration="2.58736116s" totalImagesPullingTime="493.196016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:32:12.585439052 +0000 UTC m=+1051.879127531" watchObservedRunningTime="2026-09-16 14:32:12.58736116 +0000 UTC m=+1051.881049637"
Sep 16 14:32:13.012749 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:13.012659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:13.601839 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:13.601801    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:14.385809 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:14.385771    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:15.104836 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:15.104795    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:15.829373 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:15.829319    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb" podUID="9df59576-cdc6-4a67-928e-f90c97914e6e" containerName="main" containerID="cri-o://8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8" gracePeriod=45
Sep 16 14:32:16.024438 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.024406    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:16.091285 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.091182    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:32:16.242210 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.242179    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-model-cache\") pod \"9df59576-cdc6-4a67-928e-f90c97914e6e\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") "
Sep 16 14:32:16.242617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.242217    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df59576-cdc6-4a67-928e-f90c97914e6e-tls-certs\") pod \"9df59576-cdc6-4a67-928e-f90c97914e6e\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") "
Sep 16 14:32:16.242617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.242279    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-home\") pod \"9df59576-cdc6-4a67-928e-f90c97914e6e\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") "
Sep 16 14:32:16.242617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.242303    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-dshm\") pod \"9df59576-cdc6-4a67-928e-f90c97914e6e\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") "
Sep 16 14:32:16.242617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.242325    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl9cp\" (UniqueName: \"kubernetes.io/projected/9df59576-cdc6-4a67-928e-f90c97914e6e-kube-api-access-gl9cp\") pod \"9df59576-cdc6-4a67-928e-f90c97914e6e\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") "
Sep 16 14:32:16.242617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.242349    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-tmp-dir\") pod \"9df59576-cdc6-4a67-928e-f90c97914e6e\" (UID: \"9df59576-cdc6-4a67-928e-f90c97914e6e\") "
Sep 16 14:32:16.242617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.242478    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-model-cache" (OuterVolumeSpecName: "model-cache") pod "9df59576-cdc6-4a67-928e-f90c97914e6e" (UID: "9df59576-cdc6-4a67-928e-f90c97914e6e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:32:16.242617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.242525    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-home" (OuterVolumeSpecName: "home") pod "9df59576-cdc6-4a67-928e-f90c97914e6e" (UID: "9df59576-cdc6-4a67-928e-f90c97914e6e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:32:16.242617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.242592    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-home\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:16.242617 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.242607    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-model-cache\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:16.242979 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.242720    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9df59576-cdc6-4a67-928e-f90c97914e6e" (UID: "9df59576-cdc6-4a67-928e-f90c97914e6e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:32:16.244572 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.244540    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df59576-cdc6-4a67-928e-f90c97914e6e-kube-api-access-gl9cp" (OuterVolumeSpecName: "kube-api-access-gl9cp") pod "9df59576-cdc6-4a67-928e-f90c97914e6e" (UID: "9df59576-cdc6-4a67-928e-f90c97914e6e"). InnerVolumeSpecName "kube-api-access-gl9cp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:32:16.244572 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.244546    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df59576-cdc6-4a67-928e-f90c97914e6e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9df59576-cdc6-4a67-928e-f90c97914e6e" (UID: "9df59576-cdc6-4a67-928e-f90c97914e6e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:32:16.244707 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.244546    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-dshm" (OuterVolumeSpecName: "dshm") pod "9df59576-cdc6-4a67-928e-f90c97914e6e" (UID: "9df59576-cdc6-4a67-928e-f90c97914e6e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:32:16.344012 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.343954    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-dshm\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:16.344012 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.343976    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl9cp\" (UniqueName: \"kubernetes.io/projected/9df59576-cdc6-4a67-928e-f90c97914e6e-kube-api-access-gl9cp\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:16.344012 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.343987    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df59576-cdc6-4a67-928e-f90c97914e6e-tmp-dir\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:16.344012 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.343998    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df59576-cdc6-4a67-928e-f90c97914e6e-tls-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:16.593827 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.593791    2582 generic.go:356] "Generic (PLEG): container finished" podID="9df59576-cdc6-4a67-928e-f90c97914e6e" containerID="8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8" exitCode=0
Sep 16 14:32:16.593980 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.593834    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"
Sep 16 14:32:16.593980 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.593873    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb" event={"ID":"9df59576-cdc6-4a67-928e-f90c97914e6e","Type":"ContainerDied","Data":"8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8"}
Sep 16 14:32:16.593980 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.593918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb" event={"ID":"9df59576-cdc6-4a67-928e-f90c97914e6e","Type":"ContainerDied","Data":"ec6e6fb8afc658550262b26e7881640811fb2cdf7d86d68bfe4800a7ca1c8b05"}
Sep 16 14:32:16.593980 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.593935    2582 scope.go:117] "RemoveContainer" containerID="8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8"
Sep 16 14:32:16.603144 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.603127    2582 scope.go:117] "RemoveContainer" containerID="8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8"
Sep 16 14:32:16.603436 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:32:16.603418    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8\": container with ID starting with 8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8 not found: ID does not exist" containerID="8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8"
Sep 16 14:32:16.603496 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.603443    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8"} err="failed to get container status \"8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8\": rpc error: code = NotFound desc = could not find container \"8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8\": container with ID starting with 8d6fa239e1fd01b085a881e6eeae8bd74d56f366a087519aef72d777b04cd4d8 not found: ID does not exist"
Sep 16 14:32:16.619286 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.619263    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"]
Sep 16 14:32:16.623109 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:16.623089    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-7ce904/explicit-model-7ce904-kserve-5c46d94669-ldgwb"]
Sep 16 14:32:17.180455 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:17.180423    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df59576-cdc6-4a67-928e-f90c97914e6e" path="/var/lib/kubelet/pods/9df59576-cdc6-4a67-928e-f90c97914e6e/volumes"
Sep 16 14:32:18.378141 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:18.378100    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:18.482170 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:18.482131    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:18.583323 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:18.583288    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:18.584427 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:18.584399    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"]
Sep 16 14:32:18.584592 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:18.584572    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerName="istio-proxy" containerID="cri-o://80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98" gracePeriod=30
Sep 16 14:32:18.618079 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:18.618052    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:19.394928 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.394849    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"]
Sep 16 14:32:19.395518 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.395502    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df59576-cdc6-4a67-928e-f90c97914e6e" containerName="main"
Sep 16 14:32:19.395563 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.395523    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df59576-cdc6-4a67-928e-f90c97914e6e" containerName="main"
Sep 16 14:32:19.395639 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.395629    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df59576-cdc6-4a67-928e-f90c97914e6e" containerName="main"
Sep 16 14:32:19.400205 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.400185    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.403221 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.403193    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-ec80c7-openshift-default-dockercfg-sqs6b\""
Sep 16 14:32:19.413118 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.413096    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"]
Sep 16 14:32:19.472081 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.472055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d97310-9254-400d-89d6-005f43c3f799-istio-podinfo\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.472187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.472087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-workload-socket\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.472187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.472109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-credential-socket\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.472295 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.472192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-istio-data\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.472295 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.472252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d97310-9254-400d-89d6-005f43c3f799-istiod-ca-cert\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.472400 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.472344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-workload-certs\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.472451 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.472414    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkmn2\" (UniqueName: \"kubernetes.io/projected/74d97310-9254-400d-89d6-005f43c3f799-kube-api-access-jkmn2\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.472497 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.472490    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d97310-9254-400d-89d6-005f43c3f799-istio-token\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.472544 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.472506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-istio-envoy\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.573382 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.573356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkmn2\" (UniqueName: \"kubernetes.io/projected/74d97310-9254-400d-89d6-005f43c3f799-kube-api-access-jkmn2\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.573531 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.573409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d97310-9254-400d-89d6-005f43c3f799-istio-token\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.573531 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.573457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-istio-envoy\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.573531 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.573488    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d97310-9254-400d-89d6-005f43c3f799-istio-podinfo\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.573531 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.573509    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-workload-socket\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.573531 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.573527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-credential-socket\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.573781 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.573555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-istio-data\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.573781 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.573756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d97310-9254-400d-89d6-005f43c3f799-istiod-ca-cert\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.573888 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.573812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-workload-certs\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.573964 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.573941    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-workload-socket\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.574020 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.573955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-credential-socket\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.574187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.574164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-workload-certs\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.574279 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.574185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-istio-data\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.574494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.574472    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d97310-9254-400d-89d6-005f43c3f799-istiod-ca-cert\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.575776 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.575757    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-istio-envoy\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.576029 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.576005    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d97310-9254-400d-89d6-005f43c3f799-istio-podinfo\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.587684 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.587633    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d97310-9254-400d-89d6-005f43c3f799-istio-token\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.589790 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.589761    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkmn2\" (UniqueName: \"kubernetes.io/projected/74d97310-9254-400d-89d6-005f43c3f799-kube-api-access-jkmn2\") pod \"e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") " pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.711686 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.711594    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:19.761532 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.761444    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:19.884411 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.884363    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:19.989502 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.989475    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"]
Sep 16 14:32:19.991116 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:32:19.991094    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d97310_9254_400d_89d6_005f43c3f799.slice/crio-65806315c1c93acf337f1287ad588d8ab7268aa73857f85d6fdacd341e8c667a WatchSource:0}: Error finding container 65806315c1c93acf337f1287ad588d8ab7268aa73857f85d6fdacd341e8c667a: Status 404 returned error can't find the container with id 65806315c1c93acf337f1287ad588d8ab7268aa73857f85d6fdacd341e8c667a
Sep 16 14:32:19.993540 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.993503    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:32:19.993626 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.993591    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:32:19.993670 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:19.993634    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:32:20.623190 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:20.623159    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f" event={"ID":"74d97310-9254-400d-89d6-005f43c3f799","Type":"ContainerStarted","Data":"e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c"}
Sep 16 14:32:20.623660 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:20.623217    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f" event={"ID":"74d97310-9254-400d-89d6-005f43c3f799","Type":"ContainerStarted","Data":"65806315c1c93acf337f1287ad588d8ab7268aa73857f85d6fdacd341e8c667a"}
Sep 16 14:32:20.646775 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:20.646724    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f" podStartSLOduration=1.646710237 podStartE2EDuration="1.646710237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:32:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:32:20.644294728 +0000 UTC m=+1059.937983206" watchObservedRunningTime="2026-09-16 14:32:20.646710237 +0000 UTC m=+1059.940398717"
Sep 16 14:32:20.712394 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:20.712366    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:20.931854 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:20.931763    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:21.030578 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:21.030545    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:21.256852 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:21.256763    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:21.716949 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:21.716917    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:22.486228 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:22.486193    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:22.634377 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:22.634347    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:22.635501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:22.635479    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:32:23.852168 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:23.852109    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:32:24.021582 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.021550    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istiod-ca-cert\") pod \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") "
Sep 16 14:32:24.021774 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.021588    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-workload-socket\") pod \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") "
Sep 16 14:32:24.021774 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.021644    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr7xw\" (UniqueName: \"kubernetes.io/projected/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-kube-api-access-dr7xw\") pod \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") "
Sep 16 14:32:24.021774 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.021673    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-envoy\") pod \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") "
Sep 16 14:32:24.021774 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.021703    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-workload-certs\") pod \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") "
Sep 16 14:32:24.021774 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.021718    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-token\") pod \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") "
Sep 16 14:32:24.021774 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.021770    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-podinfo\") pod \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") "
Sep 16 14:32:24.022100 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.021832    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-credential-socket\") pod \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") "
Sep 16 14:32:24.022100 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.021857    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-data\") pod \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\" (UID: \"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263\") "
Sep 16 14:32:24.022100 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.021927    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" (UID: "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:32:24.022100 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.021961    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" (UID: "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:32:24.022100 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.022084    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" (UID: "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:32:24.022412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.022220    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" (UID: "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:32:24.022412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.022257    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" (UID: "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:32:24.022412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.022351    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-workload-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:24.022412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.022369    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-credential-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:24.022412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.022379    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-data\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:24.022412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.022389    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istiod-ca-cert\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:24.022412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.022396    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-workload-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:24.024132 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.024105    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" (UID: "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:32:24.024211 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.024158    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-kube-api-access-dr7xw" (OuterVolumeSpecName: "kube-api-access-dr7xw") pod "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" (UID: "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263"). InnerVolumeSpecName "kube-api-access-dr7xw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:32:24.024380 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.024361    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" (UID: "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:32:24.024380 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.024365    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" (UID: "3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:32:24.123440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.123344    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr7xw\" (UniqueName: \"kubernetes.io/projected/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-kube-api-access-dr7xw\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:24.123440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.123380    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-envoy\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:24.123440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.123395    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-token\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:24.123440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.123406    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263-istio-podinfo\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:24.647522 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.647487    2582 generic.go:356] "Generic (PLEG): container finished" podID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerID="80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98" exitCode=0
Sep 16 14:32:24.647691 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.647534    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"
Sep 16 14:32:24.647691 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.647570    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" event={"ID":"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263","Type":"ContainerDied","Data":"80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98"}
Sep 16 14:32:24.647691 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.647629    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6" event={"ID":"3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263","Type":"ContainerDied","Data":"a899259b40bb0eb58bb2a945612ca234627fbf7cca218991450f930375434bf2"}
Sep 16 14:32:24.647691 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.647653    2582 scope.go:117] "RemoveContainer" containerID="80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98"
Sep 16 14:32:24.657847 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.657829    2582 scope.go:117] "RemoveContainer" containerID="1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff"
Sep 16 14:32:24.666159 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.666140    2582 scope.go:117] "RemoveContainer" containerID="80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98"
Sep 16 14:32:24.666452 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:32:24.666430    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98\": container with ID starting with 80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98 not found: ID does not exist" containerID="80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98"
Sep 16 14:32:24.666526 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.666461    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98"} err="failed to get container status \"80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98\": rpc error: code = NotFound desc = could not find container \"80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98\": container with ID starting with 80efbbacfa4efc1123473b6e3552a4b58f2ef5e45e1d2a9c690fe86577fb8b98 not found: ID does not exist"
Sep 16 14:32:24.666526 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.666479    2582 scope.go:117] "RemoveContainer" containerID="1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff"
Sep 16 14:32:24.666749 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:32:24.666731    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff\": container with ID starting with 1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff not found: ID does not exist" containerID="1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff"
Sep 16 14:32:24.666797 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.666754    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff"} err="failed to get container status \"1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff\": rpc error: code = NotFound desc = could not find container \"1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff\": container with ID starting with 1a5c04c1bdeacc7b26dd815b143750a7a89328a507713577da3ad21415f069ff not found: ID does not exist"
Sep 16 14:32:24.672216 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.672196    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"]
Sep 16 14:32:24.674590 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:24.674570    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6"]
Sep 16 14:32:25.180433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:25.180399    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" path="/var/lib/kubelet/pods/3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263/volumes"
Sep 16 14:32:25.537720 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:25.537692    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:33.027484 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:33.027420    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:34.039959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:34.039872    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:35.103723 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:35.103689    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:35.918288 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:35.918254    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:36.120901 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:36.120862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:36.673570 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:36.673538    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:36.837767 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:36.837727    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:37.153287 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:37.153257    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:37.607623 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:37.607573    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:39.019913 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:39.019865    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:42.272799 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:42.272762    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:32:44.715432 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:44.715399    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:44.822757 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:44.822724    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:46.304755 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:46.304715    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:47.565699 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:47.565666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:48.756134 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:48.756096    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:49.788097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:49.788065    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:50.884089 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:50.884060    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:51.735375 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:51.735340    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:55.502309 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:55.502273    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:56.035764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.035716    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"]
Sep 16 14:32:56.036509 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.036352    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj" podUID="50841575-12ac-4052-84d5-5ba623df3325" containerName="maas-api" containerID="cri-o://27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd" gracePeriod=30
Sep 16 14:32:56.079630 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.079602    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:56.210518 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.210485    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:56.280308 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.280281    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:56.337208 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.337178    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:56.420690 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.419282    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50841575-12ac-4052-84d5-5ba623df3325-openshift-service-ca\") pod \"50841575-12ac-4052-84d5-5ba623df3325\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") "
Sep 16 14:32:56.420690 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.419665    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50841575-12ac-4052-84d5-5ba623df3325-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "50841575-12ac-4052-84d5-5ba623df3325" (UID: "50841575-12ac-4052-84d5-5ba623df3325"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:32:56.420690 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.419753    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-metrics-certs\") pod \"50841575-12ac-4052-84d5-5ba623df3325\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") "
Sep 16 14:32:56.420690 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.420167    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-maas-api-tls\") pod \"50841575-12ac-4052-84d5-5ba623df3325\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") "
Sep 16 14:32:56.420690 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.420279    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srnpw\" (UniqueName: \"kubernetes.io/projected/50841575-12ac-4052-84d5-5ba623df3325-kube-api-access-srnpw\") pod \"50841575-12ac-4052-84d5-5ba623df3325\" (UID: \"50841575-12ac-4052-84d5-5ba623df3325\") "
Sep 16 14:32:56.421353 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.421313    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50841575-12ac-4052-84d5-5ba623df3325-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:56.425847 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.423215    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "50841575-12ac-4052-84d5-5ba623df3325" (UID: "50841575-12ac-4052-84d5-5ba623df3325"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:32:56.426079 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.426048    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "50841575-12ac-4052-84d5-5ba623df3325" (UID: "50841575-12ac-4052-84d5-5ba623df3325"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:32:56.426310 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.426279    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50841575-12ac-4052-84d5-5ba623df3325-kube-api-access-srnpw" (OuterVolumeSpecName: "kube-api-access-srnpw") pod "50841575-12ac-4052-84d5-5ba623df3325" (UID: "50841575-12ac-4052-84d5-5ba623df3325"). InnerVolumeSpecName "kube-api-access-srnpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:32:56.524082 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.524046    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:56.524082 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.524076    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50841575-12ac-4052-84d5-5ba623df3325-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:56.524082 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.524087    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srnpw\" (UniqueName: \"kubernetes.io/projected/50841575-12ac-4052-84d5-5ba623df3325-kube-api-access-srnpw\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:32:56.683292 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.683185    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:56.782637 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.782610    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:56.832324 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.832287    2582 generic.go:356] "Generic (PLEG): container finished" podID="50841575-12ac-4052-84d5-5ba623df3325" containerID="27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd" exitCode=0
Sep 16 14:32:56.832490 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.832339    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"
Sep 16 14:32:56.832490 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.832360    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj" event={"ID":"50841575-12ac-4052-84d5-5ba623df3325","Type":"ContainerDied","Data":"27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd"}
Sep 16 14:32:56.832490 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.832401    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj" event={"ID":"50841575-12ac-4052-84d5-5ba623df3325","Type":"ContainerDied","Data":"6f4029acfcab8dcc1bc730f25edd35cb43336abd247d4f101376e1d402de674c"}
Sep 16 14:32:56.832490 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.832423    2582 scope.go:117] "RemoveContainer" containerID="27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd"
Sep 16 14:32:56.842076 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.842057    2582 scope.go:117] "RemoveContainer" containerID="27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd"
Sep 16 14:32:56.842349 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:32:56.842328    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd\": container with ID starting with 27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd not found: ID does not exist" containerID="27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd"
Sep 16 14:32:56.842420 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.842357    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd"} err="failed to get container status \"27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd\": rpc error: code = NotFound desc = could not find container \"27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd\": container with ID starting with 27084a9d79f6ccb8fb58d9c15ce060799cd4060e48005d0eed6379bc85ce60bd not found: ID does not exist"
Sep 16 14:32:56.855119 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.855098    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"]
Sep 16 14:32:56.861150 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:56.861124    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5e366590-6898f66dc8-8dnmj"]
Sep 16 14:32:57.180412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:57.180376    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50841575-12ac-4052-84d5-5ba623df3325" path="/var/lib/kubelet/pods/50841575-12ac-4052-84d5-5ba623df3325/volumes"
Sep 16 14:32:57.423962 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:57.423929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:58.148117 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:58.148083    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:59.165987 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.165958    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:59.507764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.507687    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"]
Sep 16 14:32:59.508089 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.508076    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50841575-12ac-4052-84d5-5ba623df3325" containerName="maas-api"
Sep 16 14:32:59.508133 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.508092    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="50841575-12ac-4052-84d5-5ba623df3325" containerName="maas-api"
Sep 16 14:32:59.508133 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.508102    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerName="istio-proxy"
Sep 16 14:32:59.508133 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.508107    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerName="istio-proxy"
Sep 16 14:32:59.508133 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.508117    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerName="istio-proxy"
Sep 16 14:32:59.508133 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.508122    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerName="istio-proxy"
Sep 16 14:32:59.508314 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.508195    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerName="istio-proxy"
Sep 16 14:32:59.508314 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.508204    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c2b23fa-8612-4aca-b5e0-ae8c2ba3b263" containerName="istio-proxy"
Sep 16 14:32:59.508314 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.508210    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="50841575-12ac-4052-84d5-5ba623df3325" containerName="maas-api"
Sep 16 14:32:59.512996 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.512979    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.517741 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.517713    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5d484d\"/\"default-dockercfg-vdgm5\""
Sep 16 14:32:59.517862 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.517747    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5d484d\"/\"e2e-conflict-a-0e827697-kserve-self-signed-certs\""
Sep 16 14:32:59.517990 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.517976    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5d484d\"/\"kube-root-ca.crt\""
Sep 16 14:32:59.518047 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.518025    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5d484d\"/\"openshift-service-ca.crt\""
Sep 16 14:32:59.530568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.530546    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"]
Sep 16 14:32:59.644698 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.644667    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:32:59.651916 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.651889    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-tls-certs\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.652050 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.651938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-home\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.652095 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.652046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqn6z\" (UniqueName: \"kubernetes.io/projected/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-kube-api-access-rqn6z\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.652128 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.652110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-tmp-dir\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.652162 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.652131    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-model-cache\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.652162 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.652147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-dshm\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.753283 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.753225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqn6z\" (UniqueName: \"kubernetes.io/projected/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-kube-api-access-rqn6z\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.753444 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.753338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-tmp-dir\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.753444 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.753360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-model-cache\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.753444 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.753376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-dshm\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.753444 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.753395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-tls-certs\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.753444 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.753425    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-home\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.753795 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.753773    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-model-cache\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.753862 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.753829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-tmp-dir\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.753862 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.753852    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-home\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.755743 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.755718    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-dshm\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.756005 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.755990    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-tls-certs\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.777409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.777353    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqn6z\" (UniqueName: \"kubernetes.io/projected/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-kube-api-access-rqn6z\") pod \"e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:32:59.822789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:32:59.822763    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:33:00.112559 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:33:00.112521    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93a3baa5_6aed_49f4_a4b2_09b4c6333b3b.slice/crio-86bd039c5cd1d9e3ae9aea20eb6a6ca6f060ed1239b218406f493663e9730a4c WatchSource:0}: Error finding container 86bd039c5cd1d9e3ae9aea20eb6a6ca6f060ed1239b218406f493663e9730a4c: Status 404 returned error can't find the container with id 86bd039c5cd1d9e3ae9aea20eb6a6ca6f060ed1239b218406f493663e9730a4c
Sep 16 14:33:00.114751 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:00.114721    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"]
Sep 16 14:33:00.449677 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:00.449470    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:00.856879 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:00.856845    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw" event={"ID":"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b","Type":"ContainerStarted","Data":"0ed78cd5fa39e06b1e39cabf6ef299afd7bf5c4e935aadc39c89d15a6de074e6"}
Sep 16 14:33:00.857070 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:00.856885    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw" event={"ID":"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b","Type":"ContainerStarted","Data":"86bd039c5cd1d9e3ae9aea20eb6a6ca6f060ed1239b218406f493663e9730a4c"}
Sep 16 14:33:00.894868 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:00.894798    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw" podStartSLOduration=1.894782093 podStartE2EDuration="1.894782093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:33:00.892928638 +0000 UTC m=+1100.186617109" watchObservedRunningTime="2026-09-16 14:33:00.894782093 +0000 UTC m=+1100.188470592"
Sep 16 14:33:04.248897 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:04.248862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:04.349202 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:04.349165    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:04.538659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:04.538628    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:04.915115 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:04.915042    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:05.050193 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:05.050162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:05.195033 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:05.194945    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:09.823042 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:09.823004    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:33:09.823042 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:09.823048    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:33:09.835126 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:09.835103    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:33:09.920208 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:09.920179    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:33:11.219392 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:11.219359    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:11.322200 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:11.322168    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:11.837563 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:11.837529    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:33:11.927140 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:11.927109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:12.024615 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:12.024587    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:17.817259 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:17.817207    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:17.882296 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:17.882266    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:18.814922 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:18.814892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:19.231589 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:19.231551    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:19.743692 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:19.743657    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:22.209201 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:22.209173    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:22.858680 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:22.858644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:22.958480 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:22.958448    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:23.057755 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:23.057721    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:24.129971 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:24.129932    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:25.488127 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:25.488096    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:26.446077 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:26.446036    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:27.121430 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.121396    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"]
Sep 16 14:33:27.125209 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.125187    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.128174 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.128146    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-4c2787-serving-cert\""
Sep 16 14:33:27.138637 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.138613    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"]
Sep 16 14:33:27.159388 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.159357    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:27.207192 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.207165    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.207309 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.207219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c190e2-3382-40d2-a559-0bf0fb89b6d9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.207309 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.207295    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpkbf\" (UniqueName: \"kubernetes.io/projected/82c190e2-3382-40d2-a559-0bf0fb89b6d9-kube-api-access-lpkbf\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.207441 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.207426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.257971 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.257926    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:27.308099 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.308072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.308223 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.308147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.308223 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.308212    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c190e2-3382-40d2-a559-0bf0fb89b6d9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.308388 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:33:27.308219    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-serving-cert: secret "maas-api-e2e-shared-a-w2-4c2787-serving-cert" not found
Sep 16 14:33:27.308388 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.308256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpkbf\" (UniqueName: \"kubernetes.io/projected/82c190e2-3382-40d2-a559-0bf0fb89b6d9-kube-api-access-lpkbf\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.308388 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:33:27.308308    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-maas-api-tls podName:82c190e2-3382-40d2-a559-0bf0fb89b6d9 nodeName:}" failed. No retries permitted until 2026-09-16 14:33:27.808286483 +0000 UTC m=+1127.101974949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-maas-api-tls") pod "maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x" (UID: "82c190e2-3382-40d2-a559-0bf0fb89b6d9") : secret "maas-api-e2e-shared-a-w2-4c2787-serving-cert" not found
Sep 16 14:33:27.308911 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.308890    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c190e2-3382-40d2-a559-0bf0fb89b6d9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.310654 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.310632    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.316734 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.316715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpkbf\" (UniqueName: \"kubernetes.io/projected/82c190e2-3382-40d2-a559-0bf0fb89b6d9-kube-api-access-lpkbf\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.557076 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.557041    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:27.660664 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.660614    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:27.752084 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.752030    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:27.813067 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.812983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:27.815372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:27.815349    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:28.039309 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:28.039268    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:28.312243 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:28.312208    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"]
Sep 16 14:33:28.313754 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:33:28.313722    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c190e2_3382_40d2_a559_0bf0fb89b6d9.slice/crio-91a169e94a2433569273319ffade9e95e6c01b17fff767e5b4521dc359019639 WatchSource:0}: Error finding container 91a169e94a2433569273319ffade9e95e6c01b17fff767e5b4521dc359019639: Status 404 returned error can't find the container with id 91a169e94a2433569273319ffade9e95e6c01b17fff767e5b4521dc359019639
Sep 16 14:33:29.023020 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:29.022988    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x" event={"ID":"82c190e2-3382-40d2-a559-0bf0fb89b6d9","Type":"ContainerStarted","Data":"91a169e94a2433569273319ffade9e95e6c01b17fff767e5b4521dc359019639"}
Sep 16 14:33:30.030875 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:30.030837    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x" event={"ID":"82c190e2-3382-40d2-a559-0bf0fb89b6d9","Type":"ContainerStarted","Data":"af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626"}
Sep 16 14:33:30.031293 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:30.030914    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:30.049967 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:30.049921    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x" podStartSLOduration=1.913735757 podStartE2EDuration="3.04990607s" totalImagesPullingTime="1.136170313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:33:30.048044615 +0000 UTC m=+1129.341733094" watchObservedRunningTime="2026-09-16 14:33:30.04990607 +0000 UTC m=+1129.343594549"
Sep 16 14:33:30.923025 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:30.922989    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:33:32.712646 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:32.712610    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:33.799763 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:33.799724    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:33.866568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:33.866528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:36.041369 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:36.041340    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:33:41.825857 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:41.825824    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:49.051051 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:49.051011    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:49.942588 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:49.942539    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:50.711814 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:50.711767    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:51.585637 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:51.585591    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:52.183486 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:52.183454    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:52.989218 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:52.989183    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:53.083373 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.083333    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:53.298568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.298543    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:53.322777 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.322750    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:33:53.624245 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.624157    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"]
Sep 16 14:33:53.636905 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.636881    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.640501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.640481    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-2539c0-openshift-default-dockercfg-5n46l\""
Sep 16 14:33:53.658688 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.658663    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"]
Sep 16 14:33:53.706975 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.706748    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:53.754013 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.753976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-token\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.754013 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.754018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-credential-socket\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.754315 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.754037    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istiod-ca-cert\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.754315 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.754148    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrbqd\" (UniqueName: \"kubernetes.io/projected/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-kube-api-access-mrbqd\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.754315 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.754195    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-workload-certs\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.754315 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.754226    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-workload-socket\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.754537 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.754322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-envoy\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.754537 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.754384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-podinfo\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.754537 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.754432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-data\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.855414 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.855384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-podinfo\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.855568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.855424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-data\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.855568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.855503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-token\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.855568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.855534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-credential-socket\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.855568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.855561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istiod-ca-cert\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.855789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.855604    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrbqd\" (UniqueName: \"kubernetes.io/projected/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-kube-api-access-mrbqd\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.855789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.855632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-workload-certs\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.855789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.855658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-workload-socket\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.855789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.855708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-envoy\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.856009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.855965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-data\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.856056 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.855999    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-credential-socket\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.856196 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.856172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-workload-certs\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.856264 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.856219    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-workload-socket\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.856374 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.856356    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istiod-ca-cert\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.857781 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.857759    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-envoy\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.858073 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.858056    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-podinfo\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.863054 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.863029    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-token\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.863211 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.863193    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrbqd\" (UniqueName: \"kubernetes.io/projected/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-kube-api-access-mrbqd\") pod \"e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") " pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.947225 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.947153    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:53.993303 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:53.993274    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:54.259590 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:54.259479    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"]
Sep 16 14:33:54.262753 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:33:54.262727    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4574c3_d459_4a72_bdc6_91ced3cd28b9.slice/crio-164f8e453c51a614e83edac38f610cac5e7685c920f8a1b0c5cfc44edc1c9745 WatchSource:0}: Error finding container 164f8e453c51a614e83edac38f610cac5e7685c920f8a1b0c5cfc44edc1c9745: Status 404 returned error can't find the container with id 164f8e453c51a614e83edac38f610cac5e7685c920f8a1b0c5cfc44edc1c9745
Sep 16 14:33:54.265230 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:54.265188    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:33:54.265347 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:54.265311    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:33:54.265409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:54.265354    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:33:54.874728 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:54.874697    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:55.171576 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:55.171492    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" event={"ID":"1e4574c3-d459-4a72-bdc6-91ced3cd28b9","Type":"ContainerStarted","Data":"00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd"}
Sep 16 14:33:55.171576 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:55.171548    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" event={"ID":"1e4574c3-d459-4a72-bdc6-91ced3cd28b9","Type":"ContainerStarted","Data":"164f8e453c51a614e83edac38f610cac5e7685c920f8a1b0c5cfc44edc1c9745"}
Sep 16 14:33:55.194668 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:55.194622    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" podStartSLOduration=2.19460665 podStartE2EDuration="2.19460665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:33:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:33:55.193109835 +0000 UTC m=+1154.486798314" watchObservedRunningTime="2026-09-16 14:33:55.19460665 +0000 UTC m=+1154.488295315"
Sep 16 14:33:55.947503 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:55.947472    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:55.952500 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:55.952479    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:56.177619 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:56.177583    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:56.178474 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:56.178457    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:33:56.350723 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:56.350688    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:56.429936 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:56.429906    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"]
Sep 16 14:33:56.430196 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:56.430169    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f" podUID="74d97310-9254-400d-89d6-005f43c3f799" containerName="istio-proxy" containerID="cri-o://e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c" gracePeriod=30
Sep 16 14:33:56.431177 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:56.431154    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:56.531592 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:56.531557    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:56.732037 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:56.731946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:56.919196 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:56.919164    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:57.093867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:57.093831    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:57.207054 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:57.207021    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:57.306845 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:57.306815    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:58.303196 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:58.303166    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:59.123009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:59.122980    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:33:59.928024 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:33:59.927988    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:00.756751 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:00.756720    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:01.407757 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.407726    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:01.508320 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.508293    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:01.690417 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.690396    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:34:01.833214 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833183    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d97310-9254-400d-89d6-005f43c3f799-istiod-ca-cert\") pod \"74d97310-9254-400d-89d6-005f43c3f799\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") "
Sep 16 14:34:01.833409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833231    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-istio-data\") pod \"74d97310-9254-400d-89d6-005f43c3f799\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") "
Sep 16 14:34:01.833409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833318    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-workload-certs\") pod \"74d97310-9254-400d-89d6-005f43c3f799\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") "
Sep 16 14:34:01.833409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833357    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-credential-socket\") pod \"74d97310-9254-400d-89d6-005f43c3f799\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") "
Sep 16 14:34:01.833409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833389    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkmn2\" (UniqueName: \"kubernetes.io/projected/74d97310-9254-400d-89d6-005f43c3f799-kube-api-access-jkmn2\") pod \"74d97310-9254-400d-89d6-005f43c3f799\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") "
Sep 16 14:34:01.833645 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833423    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d97310-9254-400d-89d6-005f43c3f799-istio-token\") pod \"74d97310-9254-400d-89d6-005f43c3f799\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") "
Sep 16 14:34:01.833645 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833504    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-workload-socket\") pod \"74d97310-9254-400d-89d6-005f43c3f799\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") "
Sep 16 14:34:01.833645 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833492    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-istio-data" (OuterVolumeSpecName: "istio-data") pod "74d97310-9254-400d-89d6-005f43c3f799" (UID: "74d97310-9254-400d-89d6-005f43c3f799"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:34:01.833645 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833527    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-istio-envoy\") pod \"74d97310-9254-400d-89d6-005f43c3f799\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") "
Sep 16 14:34:01.833645 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833569    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d97310-9254-400d-89d6-005f43c3f799-istio-podinfo\") pod \"74d97310-9254-400d-89d6-005f43c3f799\" (UID: \"74d97310-9254-400d-89d6-005f43c3f799\") "
Sep 16 14:34:01.833906 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833651    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "74d97310-9254-400d-89d6-005f43c3f799" (UID: "74d97310-9254-400d-89d6-005f43c3f799"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:34:01.833906 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833654    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74d97310-9254-400d-89d6-005f43c3f799-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "74d97310-9254-400d-89d6-005f43c3f799" (UID: "74d97310-9254-400d-89d6-005f43c3f799"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:34:01.833906 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833799    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "74d97310-9254-400d-89d6-005f43c3f799" (UID: "74d97310-9254-400d-89d6-005f43c3f799"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:34:01.833906 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833889    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "74d97310-9254-400d-89d6-005f43c3f799" (UID: "74d97310-9254-400d-89d6-005f43c3f799"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:34:01.834092 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833937    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d97310-9254-400d-89d6-005f43c3f799-istiod-ca-cert\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:01.834092 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833952    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-istio-data\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:01.834092 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833968    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-workload-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:01.834092 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.833982    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-workload-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:01.836150 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.836124    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74d97310-9254-400d-89d6-005f43c3f799-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "74d97310-9254-400d-89d6-005f43c3f799" (UID: "74d97310-9254-400d-89d6-005f43c3f799"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:34:01.836295 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.836225    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74d97310-9254-400d-89d6-005f43c3f799-istio-token" (OuterVolumeSpecName: "istio-token") pod "74d97310-9254-400d-89d6-005f43c3f799" (UID: "74d97310-9254-400d-89d6-005f43c3f799"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:34:01.836295 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.836228    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74d97310-9254-400d-89d6-005f43c3f799-kube-api-access-jkmn2" (OuterVolumeSpecName: "kube-api-access-jkmn2") pod "74d97310-9254-400d-89d6-005f43c3f799" (UID: "74d97310-9254-400d-89d6-005f43c3f799"). InnerVolumeSpecName "kube-api-access-jkmn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:34:01.836391 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.836310    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "74d97310-9254-400d-89d6-005f43c3f799" (UID: "74d97310-9254-400d-89d6-005f43c3f799"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:34:01.861291 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.861169    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:01.935583 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.935509    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-istio-envoy\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:01.935583 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.935537    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d97310-9254-400d-89d6-005f43c3f799-istio-podinfo\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:01.935583 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.935546    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d97310-9254-400d-89d6-005f43c3f799-credential-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:01.935583 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.935558    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkmn2\" (UniqueName: \"kubernetes.io/projected/74d97310-9254-400d-89d6-005f43c3f799-kube-api-access-jkmn2\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:01.935583 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.935567    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d97310-9254-400d-89d6-005f43c3f799-istio-token\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:01.956644 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:01.956603    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:02.030916 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:02.030879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:02.211870 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:02.211770    2582 generic.go:356] "Generic (PLEG): container finished" podID="74d97310-9254-400d-89d6-005f43c3f799" containerID="e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c" exitCode=0
Sep 16 14:34:02.211870 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:02.211840    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"
Sep 16 14:34:02.212096 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:02.211854    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f" event={"ID":"74d97310-9254-400d-89d6-005f43c3f799","Type":"ContainerDied","Data":"e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c"}
Sep 16 14:34:02.212096 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:02.211924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f" event={"ID":"74d97310-9254-400d-89d6-005f43c3f799","Type":"ContainerDied","Data":"65806315c1c93acf337f1287ad588d8ab7268aa73857f85d6fdacd341e8c667a"}
Sep 16 14:34:02.212096 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:02.211940    2582 scope.go:117] "RemoveContainer" containerID="e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c"
Sep 16 14:34:02.222862 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:02.222840    2582 scope.go:117] "RemoveContainer" containerID="e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c"
Sep 16 14:34:02.223123 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:34:02.223103    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c\": container with ID starting with e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c not found: ID does not exist" containerID="e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c"
Sep 16 14:34:02.223190 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:02.223132    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c"} err="failed to get container status \"e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c\": rpc error: code = NotFound desc = could not find container \"e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c\": container with ID starting with e41a1e4e40f25f302ebcbee0b1fdecf17ff7a39c5cc016c10c4176277fe8943c not found: ID does not exist"
Sep 16 14:34:02.236096 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:02.236071    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"]
Sep 16 14:34:02.242385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:02.242365    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f"]
Sep 16 14:34:02.728844 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:02.728813    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:03.180028 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:03.179995    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74d97310-9254-400d-89d6-005f43c3f799" path="/var/lib/kubelet/pods/74d97310-9254-400d-89d6-005f43c3f799/volumes"
Sep 16 14:34:19.328976 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:19.328939    2582 generic.go:356] "Generic (PLEG): container finished" podID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerID="00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd" exitCode=0
Sep 16 14:34:19.329378 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:19.329012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" event={"ID":"1e4574c3-d459-4a72-bdc6-91ced3cd28b9","Type":"ContainerDied","Data":"00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd"}
Sep 16 14:34:19.329433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:19.329418    2582 scope.go:117] "RemoveContainer" containerID="00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd"
Sep 16 14:34:19.330570 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:19.330545    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:34:19.330644 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:19.330616    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:34:19.330688 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:19.330648    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:34:20.336391 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:20.336356    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" event={"ID":"1e4574c3-d459-4a72-bdc6-91ced3cd28b9","Type":"ContainerStarted","Data":"d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8"}
Sep 16 14:34:20.948107 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:20.948070    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:34:20.948330 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:20.948307    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 16 14:34:20.948381 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:20.948361    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 16 14:34:21.079297 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:21.079230    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:21.947598 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:21.947560    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 16 14:34:21.947988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:21.947631    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 16 14:34:22.126033 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:22.125998    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:22.948083 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:22.948050    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 16 14:34:22.948547 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:22.948115    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 16 14:34:23.051086 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:23.051055    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:23.935510 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:23.935472    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:23.948505 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:23.948475    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 16 14:34:23.948864 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:23.948533    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 16 14:34:24.859230 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:24.859183    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:24.948671 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:24.948640    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 16 14:34:24.949128 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:24.949101    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 16 14:34:25.718201 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:25.718156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:25.951899 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:25.951865    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:34:25.952397 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:25.952131    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:34:25.952754 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:25.952736    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:34:26.023800 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:26.023705    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:34:26.515100 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:26.515065    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:27.288599 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:27.288563    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:27.968155 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:27.968120    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:28.970708 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:28.970675    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:29.890456 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:29.890426    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:30.808654 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:30.808625    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:31.504816 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:31.504783    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:32.209226 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:32.209190    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:32.370906 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:32.370871    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:32.909659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:32.909629    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"]
Sep 16 14:34:32.909897 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:32.909867    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6" podUID="818edb12-7d23-43fc-b6c7-eebc212d8baf" containerName="maas-api" containerID="cri-o://b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3" gracePeriod=30
Sep 16 14:34:32.963458 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:32.963428    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:33.095068 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.095019    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:33.166196 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.166143    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:34:33.191892 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.191843    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:33.246302 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.246232    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-metrics-certs\") pod \"818edb12-7d23-43fc-b6c7-eebc212d8baf\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") "
Sep 16 14:34:33.246751 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.246339    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwbnd\" (UniqueName: \"kubernetes.io/projected/818edb12-7d23-43fc-b6c7-eebc212d8baf-kube-api-access-lwbnd\") pod \"818edb12-7d23-43fc-b6c7-eebc212d8baf\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") "
Sep 16 14:34:33.246751 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.246388    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-maas-api-tls\") pod \"818edb12-7d23-43fc-b6c7-eebc212d8baf\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") "
Sep 16 14:34:33.246751 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.246442    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/818edb12-7d23-43fc-b6c7-eebc212d8baf-openshift-service-ca\") pod \"818edb12-7d23-43fc-b6c7-eebc212d8baf\" (UID: \"818edb12-7d23-43fc-b6c7-eebc212d8baf\") "
Sep 16 14:34:33.246972 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.246925    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/818edb12-7d23-43fc-b6c7-eebc212d8baf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "818edb12-7d23-43fc-b6c7-eebc212d8baf" (UID: "818edb12-7d23-43fc-b6c7-eebc212d8baf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:34:33.248568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.248541    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/818edb12-7d23-43fc-b6c7-eebc212d8baf-kube-api-access-lwbnd" (OuterVolumeSpecName: "kube-api-access-lwbnd") pod "818edb12-7d23-43fc-b6c7-eebc212d8baf" (UID: "818edb12-7d23-43fc-b6c7-eebc212d8baf"). InnerVolumeSpecName "kube-api-access-lwbnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:34:33.248730 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.248549    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "818edb12-7d23-43fc-b6c7-eebc212d8baf" (UID: "818edb12-7d23-43fc-b6c7-eebc212d8baf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:34:33.248730 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.248674    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "818edb12-7d23-43fc-b6c7-eebc212d8baf" (UID: "818edb12-7d23-43fc-b6c7-eebc212d8baf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:34:33.292704 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.292677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:33.347944 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.347916    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/818edb12-7d23-43fc-b6c7-eebc212d8baf-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:33.347944 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.347940    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:33.348121 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.347952    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwbnd\" (UniqueName: \"kubernetes.io/projected/818edb12-7d23-43fc-b6c7-eebc212d8baf-kube-api-access-lwbnd\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:33.348121 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.347962    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/818edb12-7d23-43fc-b6c7-eebc212d8baf-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:33.378730 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.378695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:33.410009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.409976    2582 generic.go:356] "Generic (PLEG): container finished" podID="818edb12-7d23-43fc-b6c7-eebc212d8baf" containerID="b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3" exitCode=0
Sep 16 14:34:33.410178 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.410027    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"
Sep 16 14:34:33.410178 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.410059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6" event={"ID":"818edb12-7d23-43fc-b6c7-eebc212d8baf","Type":"ContainerDied","Data":"b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3"}
Sep 16 14:34:33.410178 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.410111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6" event={"ID":"818edb12-7d23-43fc-b6c7-eebc212d8baf","Type":"ContainerDied","Data":"20964ac68573e1f57b02ea1f9c436e356cb086617929d91a9916fe50b631f203"}
Sep 16 14:34:33.410178 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.410135    2582 scope.go:117] "RemoveContainer" containerID="b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3"
Sep 16 14:34:33.422000 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.421963    2582 scope.go:117] "RemoveContainer" containerID="b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3"
Sep 16 14:34:33.422409 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:34:33.422388    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3\": container with ID starting with b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3 not found: ID does not exist" containerID="b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3"
Sep 16 14:34:33.422479 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.422416    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3"} err="failed to get container status \"b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3\": rpc error: code = NotFound desc = could not find container \"b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3\": container with ID starting with b949e3cc8c01c02dbcc4bccc6542e239ff566d38f6c405030e09b61c784734d3 not found: ID does not exist"
Sep 16 14:34:33.435105 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.435081    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"]
Sep 16 14:34:33.438789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.438768    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-094dab-5f7974584f-57cr6"]
Sep 16 14:34:33.699021 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.698923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:33.793134 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:33.793100    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:34.906985 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:34.906955    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:35.181296 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:35.181191    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="818edb12-7d23-43fc-b6c7-eebc212d8baf" path="/var/lib/kubelet/pods/818edb12-7d23-43fc-b6c7-eebc212d8baf/volumes"
Sep 16 14:34:35.979627 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:35.979593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:36.325984 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.325950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:36.805681 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.805643    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7605-f8519a"]
Sep 16 14:34:36.806136 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.806118    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="818edb12-7d23-43fc-b6c7-eebc212d8baf" containerName="maas-api"
Sep 16 14:34:36.806281 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.806139    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="818edb12-7d23-43fc-b6c7-eebc212d8baf" containerName="maas-api"
Sep 16 14:34:36.806281 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.806186    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74d97310-9254-400d-89d6-005f43c3f799" containerName="istio-proxy"
Sep 16 14:34:36.806281 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.806195    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="74d97310-9254-400d-89d6-005f43c3f799" containerName="istio-proxy"
Sep 16 14:34:36.806450 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.806312    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="74d97310-9254-400d-89d6-005f43c3f799" containerName="istio-proxy"
Sep 16 14:34:36.806450 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.806326    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="818edb12-7d23-43fc-b6c7-eebc212d8baf" containerName="maas-api"
Sep 16 14:34:36.810858 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.810837    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-f8519a"
Sep 16 14:34:36.814005 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.813989    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gn749\""
Sep 16 14:34:36.822866 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.822842    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7605-f8519a"]
Sep 16 14:34:36.887395 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.887363    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:36.979172 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:36.979140    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn9kx\" (UniqueName: \"kubernetes.io/projected/240f88af-aaaf-46ab-b31c-6ed168a72b97-kube-api-access-cn9kx\") pod \"test-curl-7605-f8519a\" (UID: \"240f88af-aaaf-46ab-b31c-6ed168a72b97\") " pod="opendatahub/test-curl-7605-f8519a"
Sep 16 14:34:37.080491 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:37.080397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn9kx\" (UniqueName: \"kubernetes.io/projected/240f88af-aaaf-46ab-b31c-6ed168a72b97-kube-api-access-cn9kx\") pod \"test-curl-7605-f8519a\" (UID: \"240f88af-aaaf-46ab-b31c-6ed168a72b97\") " pod="opendatahub/test-curl-7605-f8519a"
Sep 16 14:34:37.093866 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:37.093845    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn9kx\" (UniqueName: \"kubernetes.io/projected/240f88af-aaaf-46ab-b31c-6ed168a72b97-kube-api-access-cn9kx\") pod \"test-curl-7605-f8519a\" (UID: \"240f88af-aaaf-46ab-b31c-6ed168a72b97\") " pod="opendatahub/test-curl-7605-f8519a"
Sep 16 14:34:37.119893 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:37.119870    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-f8519a"
Sep 16 14:34:37.408671 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:37.408641    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7605-f8519a"]
Sep 16 14:34:37.410330 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:34:37.410301    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod240f88af_aaaf_46ab_b31c_6ed168a72b97.slice/crio-90669b7b7f7e1a157b7ff60feda136958973a61c08985a5c7f685c23082a3f0a WatchSource:0}: Error finding container 90669b7b7f7e1a157b7ff60feda136958973a61c08985a5c7f685c23082a3f0a: Status 404 returned error can't find the container with id 90669b7b7f7e1a157b7ff60feda136958973a61c08985a5c7f685c23082a3f0a
Sep 16 14:34:37.435346 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:37.435323    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7605-f8519a" event={"ID":"240f88af-aaaf-46ab-b31c-6ed168a72b97","Type":"ContainerStarted","Data":"90669b7b7f7e1a157b7ff60feda136958973a61c08985a5c7f685c23082a3f0a"}
Sep 16 14:34:37.764343 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:37.764256    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:38.442940 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:38.442864    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7605-f8519a" event={"ID":"240f88af-aaaf-46ab-b31c-6ed168a72b97","Type":"ContainerStarted","Data":"dbcea22b3545cc3eedec980866119d66f6a2c2b361e39b872ccce3f145061c68"}
Sep 16 14:34:38.465780 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:38.465734    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7605-f8519a" podStartSLOduration=1.70911934 podStartE2EDuration="2.465720298s" totalImagesPullingTime="756.600958ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:34:38.465448956 +0000 UTC m=+1197.759137433" watchObservedRunningTime="2026-09-16 14:34:38.465720298 +0000 UTC m=+1197.759408776"
Sep 16 14:34:38.740275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:38.740192    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:39.099622 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.099590    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7605-f8519a"]
Sep 16 14:34:39.105966 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.105934    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7605-f8519a"]
Sep 16 14:34:39.228536 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.228502    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7605-a25f0c"]
Sep 16 14:34:39.228902 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.228890    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240f88af-aaaf-46ab-b31c-6ed168a72b97" containerName="test-curl-7605-f8519a"
Sep 16 14:34:39.228955 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.228905    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="240f88af-aaaf-46ab-b31c-6ed168a72b97" containerName="test-curl-7605-f8519a"
Sep 16 14:34:39.228991 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.228975    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="240f88af-aaaf-46ab-b31c-6ed168a72b97" containerName="test-curl-7605-f8519a"
Sep 16 14:34:39.232190 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.232175    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-a25f0c"
Sep 16 14:34:39.253036 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.253010    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7605-a25f0c"]
Sep 16 14:34:39.400176 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.400083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj7fs\" (UniqueName: \"kubernetes.io/projected/e24aa51c-5e7e-4494-a174-bbf3b7442521-kube-api-access-hj7fs\") pod \"test-curl-7605-a25f0c\" (UID: \"e24aa51c-5e7e-4494-a174-bbf3b7442521\") " pod="opendatahub/test-curl-7605-a25f0c"
Sep 16 14:34:39.448558 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:34:39.448531    2582 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7605-f8519a" container="test-curl-7605-f8519a"
Sep 16 14:34:39.501405 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.501378    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj7fs\" (UniqueName: \"kubernetes.io/projected/e24aa51c-5e7e-4494-a174-bbf3b7442521-kube-api-access-hj7fs\") pod \"test-curl-7605-a25f0c\" (UID: \"e24aa51c-5e7e-4494-a174-bbf3b7442521\") " pod="opendatahub/test-curl-7605-a25f0c"
Sep 16 14:34:39.511305 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.511281    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj7fs\" (UniqueName: \"kubernetes.io/projected/e24aa51c-5e7e-4494-a174-bbf3b7442521-kube-api-access-hj7fs\") pod \"test-curl-7605-a25f0c\" (UID: \"e24aa51c-5e7e-4494-a174-bbf3b7442521\") " pod="opendatahub/test-curl-7605-a25f0c"
Sep 16 14:34:39.541353 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.541329    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-a25f0c"
Sep 16 14:34:39.813990 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:39.813966    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7605-a25f0c"]
Sep 16 14:34:39.815576 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:34:39.815548    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode24aa51c_5e7e_4494_a174_bbf3b7442521.slice/crio-9f0e426b338e311a7f5d4041e3bfc0bc95b9b3a93ce923aeabfc23672e2089da WatchSource:0}: Error finding container 9f0e426b338e311a7f5d4041e3bfc0bc95b9b3a93ce923aeabfc23672e2089da: Status 404 returned error can't find the container with id 9f0e426b338e311a7f5d4041e3bfc0bc95b9b3a93ce923aeabfc23672e2089da
Sep 16 14:34:40.437647 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:40.437612    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:40.455099 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:40.455075    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7605-a25f0c" event={"ID":"e24aa51c-5e7e-4494-a174-bbf3b7442521","Type":"ContainerStarted","Data":"241447d621b809144f92771f637e2c36fc1ad3efb04f4c2078993d8cbb3c456d"}
Sep 16 14:34:40.455508 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:40.455101    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7605-f8519a" podUID="240f88af-aaaf-46ab-b31c-6ed168a72b97" containerName="test-curl-7605-f8519a" containerID="cri-o://dbcea22b3545cc3eedec980866119d66f6a2c2b361e39b872ccce3f145061c68" gracePeriod=2
Sep 16 14:34:40.455508 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:40.455112    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7605-a25f0c" event={"ID":"e24aa51c-5e7e-4494-a174-bbf3b7442521","Type":"ContainerStarted","Data":"9f0e426b338e311a7f5d4041e3bfc0bc95b9b3a93ce923aeabfc23672e2089da"}
Sep 16 14:34:40.485418 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:40.485366    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7605-a25f0c" podStartSLOduration=1.485350442 podStartE2EDuration="1.485350442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:34:40.48388821 +0000 UTC m=+1199.777576693" watchObservedRunningTime="2026-09-16 14:34:40.485350442 +0000 UTC m=+1199.779038960"
Sep 16 14:34:41.066872 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:41.066829    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:41.173932 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:41.173827    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7605-a25f0c"]
Sep 16 14:34:41.183991 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:41.183962    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7605-a25f0c"]
Sep 16 14:34:41.185096 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:41.185068    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:41.460312 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:41.460087    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:41.464376 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:34:41.463683    2582 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7605-a25f0c" container="test-curl-7605-a25f0c"
Sep 16 14:34:41.792809 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:41.792766    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:41.890173 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:41.890140    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:42.103440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:42.103351    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:42.270037 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:42.270002    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:42.471441 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:42.471411    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7605-a25f0c" podUID="e24aa51c-5e7e-4494-a174-bbf3b7442521" containerName="test-curl-7605-a25f0c" containerID="cri-o://241447d621b809144f92771f637e2c36fc1ad3efb04f4c2078993d8cbb3c456d" gracePeriod=2
Sep 16 14:34:42.474579 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:34:42.474547    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7605-a25f0c\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="e24aa51c-5e7e-4494-a174-bbf3b7442521" pod="opendatahub/test-curl-7605-a25f0c"
Sep 16 14:34:42.643498 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:42.643475    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-f8519a"
Sep 16 14:34:42.646796 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:34:42.646770    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7605-a25f0c\" is forbidden: User \"system:node:ip-10-0-132-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-137.ec2.internal' and this object" podUID="e24aa51c-5e7e-4494-a174-bbf3b7442521" pod="opendatahub/test-curl-7605-a25f0c"
Sep 16 14:34:42.731652 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:42.731596    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn9kx\" (UniqueName: \"kubernetes.io/projected/240f88af-aaaf-46ab-b31c-6ed168a72b97-kube-api-access-cn9kx\") pod \"240f88af-aaaf-46ab-b31c-6ed168a72b97\" (UID: \"240f88af-aaaf-46ab-b31c-6ed168a72b97\") "
Sep 16 14:34:42.733567 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:42.733540    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240f88af-aaaf-46ab-b31c-6ed168a72b97-kube-api-access-cn9kx" (OuterVolumeSpecName: "kube-api-access-cn9kx") pod "240f88af-aaaf-46ab-b31c-6ed168a72b97" (UID: "240f88af-aaaf-46ab-b31c-6ed168a72b97"). InnerVolumeSpecName "kube-api-access-cn9kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:34:42.833252 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:42.833209    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn9kx\" (UniqueName: \"kubernetes.io/projected/240f88af-aaaf-46ab-b31c-6ed168a72b97-kube-api-access-cn9kx\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:42.998697 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:42.998583    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:43.186251 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:43.186208    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="240f88af-aaaf-46ab-b31c-6ed168a72b97" path="/var/lib/kubelet/pods/240f88af-aaaf-46ab-b31c-6ed168a72b97/volumes"
Sep 16 14:34:43.478568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:43.478530    2582 generic.go:356] "Generic (PLEG): container finished" podID="240f88af-aaaf-46ab-b31c-6ed168a72b97" containerID="dbcea22b3545cc3eedec980866119d66f6a2c2b361e39b872ccce3f145061c68" exitCode=137
Sep 16 14:34:43.478927 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:43.478592    2582 scope.go:117] "RemoveContainer" containerID="dbcea22b3545cc3eedec980866119d66f6a2c2b361e39b872ccce3f145061c68"
Sep 16 14:34:43.478927 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:43.478588    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-f8519a"
Sep 16 14:34:43.487542 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:43.487522    2582 scope.go:117] "RemoveContainer" containerID="dbcea22b3545cc3eedec980866119d66f6a2c2b361e39b872ccce3f145061c68"
Sep 16 14:34:43.487823 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:34:43.487802    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbcea22b3545cc3eedec980866119d66f6a2c2b361e39b872ccce3f145061c68\": container with ID starting with dbcea22b3545cc3eedec980866119d66f6a2c2b361e39b872ccce3f145061c68 not found: ID does not exist" containerID="dbcea22b3545cc3eedec980866119d66f6a2c2b361e39b872ccce3f145061c68"
Sep 16 14:34:43.487872 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:43.487831    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbcea22b3545cc3eedec980866119d66f6a2c2b361e39b872ccce3f145061c68"} err="failed to get container status \"dbcea22b3545cc3eedec980866119d66f6a2c2b361e39b872ccce3f145061c68\": rpc error: code = NotFound desc = could not find container \"dbcea22b3545cc3eedec980866119d66f6a2c2b361e39b872ccce3f145061c68\": container with ID starting with dbcea22b3545cc3eedec980866119d66f6a2c2b361e39b872ccce3f145061c68 not found: ID does not exist"
Sep 16 14:34:43.819164 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:43.819130    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:44.617717 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:44.617693    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-a25f0c"
Sep 16 14:34:44.750467 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:44.750375    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj7fs\" (UniqueName: \"kubernetes.io/projected/e24aa51c-5e7e-4494-a174-bbf3b7442521-kube-api-access-hj7fs\") pod \"e24aa51c-5e7e-4494-a174-bbf3b7442521\" (UID: \"e24aa51c-5e7e-4494-a174-bbf3b7442521\") "
Sep 16 14:34:44.752807 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:44.752759    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e24aa51c-5e7e-4494-a174-bbf3b7442521-kube-api-access-hj7fs" (OuterVolumeSpecName: "kube-api-access-hj7fs") pod "e24aa51c-5e7e-4494-a174-bbf3b7442521" (UID: "e24aa51c-5e7e-4494-a174-bbf3b7442521"). InnerVolumeSpecName "kube-api-access-hj7fs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:34:44.755919 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:44.755895    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:34:44.806913 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:44.806875    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:44.852122 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:44.852100    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj7fs\" (UniqueName: \"kubernetes.io/projected/e24aa51c-5e7e-4494-a174-bbf3b7442521-kube-api-access-hj7fs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:45.180719 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:45.180687    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e24aa51c-5e7e-4494-a174-bbf3b7442521" path="/var/lib/kubelet/pods/e24aa51c-5e7e-4494-a174-bbf3b7442521/volumes"
Sep 16 14:34:45.365145 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:45.365105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:45.477797 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:45.477718    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:45.492547 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:45.492513    2582 generic.go:356] "Generic (PLEG): container finished" podID="e24aa51c-5e7e-4494-a174-bbf3b7442521" containerID="241447d621b809144f92771f637e2c36fc1ad3efb04f4c2078993d8cbb3c456d" exitCode=137
Sep 16 14:34:45.492680 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:45.492554    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7605-a25f0c"
Sep 16 14:34:45.492680 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:45.492595    2582 scope.go:117] "RemoveContainer" containerID="241447d621b809144f92771f637e2c36fc1ad3efb04f4c2078993d8cbb3c456d"
Sep 16 14:34:45.501366 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:45.501344    2582 scope.go:117] "RemoveContainer" containerID="241447d621b809144f92771f637e2c36fc1ad3efb04f4c2078993d8cbb3c456d"
Sep 16 14:34:45.501649 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:34:45.501624    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"241447d621b809144f92771f637e2c36fc1ad3efb04f4c2078993d8cbb3c456d\": container with ID starting with 241447d621b809144f92771f637e2c36fc1ad3efb04f4c2078993d8cbb3c456d not found: ID does not exist" containerID="241447d621b809144f92771f637e2c36fc1ad3efb04f4c2078993d8cbb3c456d"
Sep 16 14:34:45.501731 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:45.501660    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241447d621b809144f92771f637e2c36fc1ad3efb04f4c2078993d8cbb3c456d"} err="failed to get container status \"241447d621b809144f92771f637e2c36fc1ad3efb04f4c2078993d8cbb3c456d\": rpc error: code = NotFound desc = could not find container \"241447d621b809144f92771f637e2c36fc1ad3efb04f4c2078993d8cbb3c456d\": container with ID starting with 241447d621b809144f92771f637e2c36fc1ad3efb04f4c2078993d8cbb3c456d not found: ID does not exist"
Sep 16 14:34:46.040790 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:46.040747    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:46.887644 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:46.887611    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:47.762294 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:47.762215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:48.838129 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:48.838064    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:48.934585 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:48.934536    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:49.173070 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:49.172959    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:49.370494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:49.370462    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:49.499495 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:49.499395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:49.850351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:49.850312    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:50.831511 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:50.831476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:51.803824 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:51.803783    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:52.582690 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.582654    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"]
Sep 16 14:34:52.582885 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.582863    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44" podUID="6bfaf04a-cf04-46db-a285-1bc7710784b6" containerName="maas-api" containerID="cri-o://5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8" gracePeriod=30
Sep 16 14:34:52.622541 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.622510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:52.709674 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.709643    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:52.813850 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.813820    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:52.827593 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.827572    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:34:52.913726 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.913650    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:52.923449 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.923428    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmrgw\" (UniqueName: \"kubernetes.io/projected/6bfaf04a-cf04-46db-a285-1bc7710784b6-kube-api-access-jmrgw\") pod \"6bfaf04a-cf04-46db-a285-1bc7710784b6\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") "
Sep 16 14:34:52.923517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.923477    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-maas-api-tls\") pod \"6bfaf04a-cf04-46db-a285-1bc7710784b6\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") "
Sep 16 14:34:52.923590 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.923575    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bfaf04a-cf04-46db-a285-1bc7710784b6-openshift-service-ca\") pod \"6bfaf04a-cf04-46db-a285-1bc7710784b6\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") "
Sep 16 14:34:52.923641 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.923618    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-metrics-certs\") pod \"6bfaf04a-cf04-46db-a285-1bc7710784b6\" (UID: \"6bfaf04a-cf04-46db-a285-1bc7710784b6\") "
Sep 16 14:34:52.923947 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.923919    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bfaf04a-cf04-46db-a285-1bc7710784b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6bfaf04a-cf04-46db-a285-1bc7710784b6" (UID: "6bfaf04a-cf04-46db-a285-1bc7710784b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:34:52.925705 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.925672    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6bfaf04a-cf04-46db-a285-1bc7710784b6" (UID: "6bfaf04a-cf04-46db-a285-1bc7710784b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:34:52.925793 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.925730    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6bfaf04a-cf04-46db-a285-1bc7710784b6" (UID: "6bfaf04a-cf04-46db-a285-1bc7710784b6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:34:52.925793 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:52.925744    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bfaf04a-cf04-46db-a285-1bc7710784b6-kube-api-access-jmrgw" (OuterVolumeSpecName: "kube-api-access-jmrgw") pod "6bfaf04a-cf04-46db-a285-1bc7710784b6" (UID: "6bfaf04a-cf04-46db-a285-1bc7710784b6"). InnerVolumeSpecName "kube-api-access-jmrgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:34:53.015635 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.015568    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:53.026103 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.025999    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bfaf04a-cf04-46db-a285-1bc7710784b6-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:53.026103 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.026037    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:53.026103 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.026053    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmrgw\" (UniqueName: \"kubernetes.io/projected/6bfaf04a-cf04-46db-a285-1bc7710784b6-kube-api-access-jmrgw\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:53.026103 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.026066    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bfaf04a-cf04-46db-a285-1bc7710784b6-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:34:53.349782 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.349751    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:53.437131 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.437098    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:53.539322 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.539294    2582 generic.go:356] "Generic (PLEG): container finished" podID="6bfaf04a-cf04-46db-a285-1bc7710784b6" containerID="5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8" exitCode=0
Sep 16 14:34:53.539484 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.539338    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"
Sep 16 14:34:53.539484 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.539376    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44" event={"ID":"6bfaf04a-cf04-46db-a285-1bc7710784b6","Type":"ContainerDied","Data":"5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8"}
Sep 16 14:34:53.539484 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.539434    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44" event={"ID":"6bfaf04a-cf04-46db-a285-1bc7710784b6","Type":"ContainerDied","Data":"631a5af341dfdcd8f197d9afc60982bfa0f28f10dca39cd8ddc28d2c7edd1c8b"}
Sep 16 14:34:53.539484 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.539459    2582 scope.go:117] "RemoveContainer" containerID="5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8"
Sep 16 14:34:53.548843 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.548827    2582 scope.go:117] "RemoveContainer" containerID="5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8"
Sep 16 14:34:53.549125 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:34:53.549104    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8\": container with ID starting with 5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8 not found: ID does not exist" containerID="5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8"
Sep 16 14:34:53.549177 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.549134    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8"} err="failed to get container status \"5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8\": rpc error: code = NotFound desc = could not find container \"5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8\": container with ID starting with 5d3392ea1afad60aeb17f7e81e28269fd6f9b281870c6c90a919d194aa3cf3e8 not found: ID does not exist"
Sep 16 14:34:53.560104 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.560082    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"]
Sep 16 14:34:53.573699 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:53.573675    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d0b89a-7458ddf5cb-vdm44"]
Sep 16 14:34:54.418275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:54.418223    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:55.180548 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:55.180511    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bfaf04a-cf04-46db-a285-1bc7710784b6" path="/var/lib/kubelet/pods/6bfaf04a-cf04-46db-a285-1bc7710784b6/volumes"
Sep 16 14:34:56.099177 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.099137    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:56.260500 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.260472    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"]
Sep 16 14:34:56.260841 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.260829    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e24aa51c-5e7e-4494-a174-bbf3b7442521" containerName="test-curl-7605-a25f0c"
Sep 16 14:34:56.260885 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.260843    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e24aa51c-5e7e-4494-a174-bbf3b7442521" containerName="test-curl-7605-a25f0c"
Sep 16 14:34:56.260885 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.260866    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bfaf04a-cf04-46db-a285-1bc7710784b6" containerName="maas-api"
Sep 16 14:34:56.260885 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.260872    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bfaf04a-cf04-46db-a285-1bc7710784b6" containerName="maas-api"
Sep 16 14:34:56.260984 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.260934    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bfaf04a-cf04-46db-a285-1bc7710784b6" containerName="maas-api"
Sep 16 14:34:56.260984 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.260942    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e24aa51c-5e7e-4494-a174-bbf3b7442521" containerName="test-curl-7605-a25f0c"
Sep 16 14:34:56.265409 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.265389    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.271727 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.271443    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5d484d\"/\"e2e-conflict-b-0e827697-kserve-self-signed-certs\""
Sep 16 14:34:56.299143 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.299119    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"]
Sep 16 14:34:56.358894 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.358825    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9jzl\" (UniqueName: \"kubernetes.io/projected/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-kube-api-access-k9jzl\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.358894 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.358869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-tls-certs\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.358894 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.358885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-home\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.359089 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.358902    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-tmp-dir\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.359089 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.358984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-dshm\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.359089 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.359009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-model-cache\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.459882 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.459846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-tls-certs\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.459882 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.459879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-home\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.460087 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.459896    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-tmp-dir\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.460087 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.459990    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-dshm\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.460087 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.460038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-model-cache\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.460290 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.460180    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9jzl\" (UniqueName: \"kubernetes.io/projected/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-kube-api-access-k9jzl\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.460360 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.460333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-home\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.460416 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.460358    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-tmp-dir\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.460416 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.460403    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-model-cache\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.462360 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.462342    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-dshm\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.462581 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.462560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-tls-certs\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.494290 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.494264    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9jzl\" (UniqueName: \"kubernetes.io/projected/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-kube-api-access-k9jzl\") pod \"e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") " pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.574405 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.574385    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:34:56.652507 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.652477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:56.871926 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:56.871896    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"]
Sep 16 14:34:56.875191 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:34:56.875169    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b5f1fb4_96c0_4a23_9d16_0b83307fea01.slice/crio-3963c253d8b715192a5207a21cfbe76f24cf33ca14ea0fbad87b99ac378dfa98 WatchSource:0}: Error finding container 3963c253d8b715192a5207a21cfbe76f24cf33ca14ea0fbad87b99ac378dfa98: Status 404 returned error can't find the container with id 3963c253d8b715192a5207a21cfbe76f24cf33ca14ea0fbad87b99ac378dfa98
Sep 16 14:34:57.570167 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:57.570134    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh" event={"ID":"0b5f1fb4-96c0-4a23-9d16-0b83307fea01","Type":"ContainerStarted","Data":"30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27"}
Sep 16 14:34:57.570167 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:57.570181    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh" event={"ID":"0b5f1fb4-96c0-4a23-9d16-0b83307fea01","Type":"ContainerStarted","Data":"3963c253d8b715192a5207a21cfbe76f24cf33ca14ea0fbad87b99ac378dfa98"}
Sep 16 14:34:57.617859 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:57.617793    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh" podStartSLOduration=1.61776913 podStartE2EDuration="1.61776913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:34:57.614075913 +0000 UTC m=+1216.907764390" watchObservedRunningTime="2026-09-16 14:34:57.61776913 +0000 UTC m=+1216.911457611"
Sep 16 14:34:57.896190 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:57.896105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:34:59.638575 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:34:59.638547    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:00.157118 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:00.157083    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:01.069619 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:01.069585    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:02.372391 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:02.372356    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:03.377436 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:03.377359    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:03.916946 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:03.916913    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:04.015735 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:04.015695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:04.293449 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:04.293414    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:04.425103 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:04.425055    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:04.584599 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:04.584511    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:04.800297 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:04.800229    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:05.167570 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.167541    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"]
Sep 16 14:35:05.171319 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.171298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.174710 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.174688    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-9f88e1-openshift-default-dockercfg-dkdbq\""
Sep 16 14:35:05.199511 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.199489    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"]
Sep 16 14:35:05.214901 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.214869    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:05.244404 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.244382    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjw4v\" (UniqueName: \"kubernetes.io/projected/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-kube-api-access-wjw4v\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.244532 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.244440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-podinfo\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.244606 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.244522    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-envoy\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.244606 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.244564    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istiod-ca-cert\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.244717 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.244645    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-workload-socket\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.244717 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.244702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-data\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.244827 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.244739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-credential-socket\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.244827 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.244779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-workload-certs\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.244898 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.244842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-token\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.345758 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.345725    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-envoy\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.345946 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.345764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istiod-ca-cert\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.345946 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.345804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-workload-socket\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.345946 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.345832    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-data\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.345946 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.345857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-credential-socket\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.345946 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.345877    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-workload-certs\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.345946 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.345895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-token\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.345946 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.345931    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjw4v\" (UniqueName: \"kubernetes.io/projected/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-kube-api-access-wjw4v\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.346326 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.346007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-podinfo\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.346326 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.346262    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-credential-socket\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.346326 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.346284    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-data\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.346478 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.346389    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-workload-certs\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.346515 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.346485    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-workload-socket\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.346728 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.346710    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istiod-ca-cert\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.348044 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.348022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-envoy\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.348469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.348449    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-podinfo\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.360123 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.360091    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-token\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.362023 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.362000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjw4v\" (UniqueName: \"kubernetes.io/projected/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-kube-api-access-wjw4v\") pod \"e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") " pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.429577 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.429479    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:05.483868 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.483837    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:05.703415 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.703331    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:05.800020 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.799994    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"]
Sep 16 14:35:05.801746 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:35:05.801720    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c45e664_8868_43fe_b0f3_2c5b058cc5a1.slice/crio-a3d928eb977fa9ab7aeeda4d220fb75b808f67e4854c2c3a4f5bebc3a2dcf917 WatchSource:0}: Error finding container a3d928eb977fa9ab7aeeda4d220fb75b808f67e4854c2c3a4f5bebc3a2dcf917: Status 404 returned error can't find the container with id a3d928eb977fa9ab7aeeda4d220fb75b808f67e4854c2c3a4f5bebc3a2dcf917
Sep 16 14:35:05.804005 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.803971    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:35:05.804062 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.804042    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:35:05.804110 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:05.804068    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:35:06.575272 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:06.575221    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:35:06.575649 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:06.575291    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:35:06.587593 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:06.587570    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:35:06.620127 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:06.620098    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" event={"ID":"6c45e664-8868-43fe-b0f3-2c5b058cc5a1","Type":"ContainerStarted","Data":"64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044"}
Sep 16 14:35:06.620288 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:06.620145    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" event={"ID":"6c45e664-8868-43fe-b0f3-2c5b058cc5a1","Type":"ContainerStarted","Data":"a3d928eb977fa9ab7aeeda4d220fb75b808f67e4854c2c3a4f5bebc3a2dcf917"}
Sep 16 14:35:06.631327 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:06.631308    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:35:06.651440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:06.651391    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" podStartSLOduration=1.6513771720000001 podStartE2EDuration="1.651377172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:06.650443362 +0000 UTC m=+1225.944131841" watchObservedRunningTime="2026-09-16 14:35:06.651377172 +0000 UTC m=+1225.945065729"
Sep 16 14:35:06.955687 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:06.955597    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:07.484548 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:07.484511    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:07.489730 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:07.489706    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:07.625700 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:07.625662    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:07.626573 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:07.626554    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:35:10.018096 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:10.018043    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:16.681169 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:16.681126    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:35:31.415635 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:31.415601    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:32.084083 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:32.084045    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:32.190579 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:32.190545    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:32.367640 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:32.367520    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:33.439027 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:33.438998    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:34.669758 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:34.669725    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:35.600758 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:35.600704    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:37.018070 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:37.018033    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:37.690223 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:37.690195    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:38.527286 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:38.527222    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:38.631494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:38.631465    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:39.403213 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:39.403176    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:39.613650 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:39.613610    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:48.948529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:48.948489    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:35:59.941773 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:59.941698    2582 generic.go:356] "Generic (PLEG): container finished" podID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerID="64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044" exitCode=0
Sep 16 14:35:59.942146 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:59.941772    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" event={"ID":"6c45e664-8868-43fe-b0f3-2c5b058cc5a1","Type":"ContainerDied","Data":"64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044"}
Sep 16 14:35:59.942187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:59.942172    2582 scope.go:117] "RemoveContainer" containerID="64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044"
Sep 16 14:35:59.943482 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:59.943454    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:35:59.943582 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:59.943526    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:35:59.943582 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:35:59.943557    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:36:00.949203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:00.949167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" event={"ID":"6c45e664-8868-43fe-b0f3-2c5b058cc5a1","Type":"ContainerStarted","Data":"79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d"}
Sep 16 14:36:01.484350 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:01.484315    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:36:01.484744 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:01.484652    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 16 14:36:01.484984 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:01.484956    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 16 14:36:01.778175 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:01.778063    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:02.306039 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:02.306005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:02.484927 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:02.484885    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 16 14:36:02.485151 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:02.484959    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 16 14:36:02.627501 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:02.627408    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:03.484768 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:03.484719    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 16 14:36:03.485293 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:03.484795    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 16 14:36:03.498488 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:03.498453    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:03.602924 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:03.602892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:04.484976 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:04.484935    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 16 14:36:04.486012 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:04.485594    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 16 14:36:05.191896 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:05.191850    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:05.484706 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:05.484611    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 16 14:36:05.484967 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:05.484940    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 16 14:36:06.488184 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:06.488154    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:36:06.488590 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:06.488531    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:36:06.489190 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:06.489171    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:36:06.653094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:06.653064    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:07.376681 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:07.376645    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:07.495016 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:07.494984    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:07.917340 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:07.917296    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:08.935526 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:08.935490    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:09.798356 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:09.798319    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:10.559065 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.559033    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"]
Sep 16 14:36:10.562513 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.562492    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.565710 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.565683    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-055ce3-serving-cert\""
Sep 16 14:36:10.585459 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.585437    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"]
Sep 16 14:36:10.613532 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.613482    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:10.684874 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.684840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcqxg\" (UniqueName: \"kubernetes.io/projected/2b7293cf-538e-43a9-b5db-dce81622ecb4-kube-api-access-fcqxg\") pod \"maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.685042 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.684885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7293cf-538e-43a9-b5db-dce81622ecb4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.685042 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.684921    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b7293cf-538e-43a9-b5db-dce81622ecb4-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.685042 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.684972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b7293cf-538e-43a9-b5db-dce81622ecb4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.711513 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.711481    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:10.786255 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.786211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcqxg\" (UniqueName: \"kubernetes.io/projected/2b7293cf-538e-43a9-b5db-dce81622ecb4-kube-api-access-fcqxg\") pod \"maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.786466 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.786306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7293cf-538e-43a9-b5db-dce81622ecb4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.786466 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.786339    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b7293cf-538e-43a9-b5db-dce81622ecb4-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.786466 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.786357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b7293cf-538e-43a9-b5db-dce81622ecb4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.787070 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.787040    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7293cf-538e-43a9-b5db-dce81622ecb4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.789051 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.789021    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b7293cf-538e-43a9-b5db-dce81622ecb4-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.789147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.789021    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b7293cf-538e-43a9-b5db-dce81622ecb4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.796199 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.796174    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcqxg\" (UniqueName: \"kubernetes.io/projected/2b7293cf-538e-43a9-b5db-dce81622ecb4-kube-api-access-fcqxg\") pod \"maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:10.815975 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.815909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:10.872746 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:10.872716    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:11.168698 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.168665    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"]
Sep 16 14:36:11.169898 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:36:11.169872    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7293cf_538e_43a9_b5db_dce81622ecb4.slice/crio-05ae9d41eabed5c98ba21d39a453cb077f0b77e11899a03b877465526ac88c34 WatchSource:0}: Error finding container 05ae9d41eabed5c98ba21d39a453cb077f0b77e11899a03b877465526ac88c34: Status 404 returned error can't find the container with id 05ae9d41eabed5c98ba21d39a453cb077f0b77e11899a03b877465526ac88c34
Sep 16 14:36:11.618255 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.618209    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"]
Sep 16 14:36:11.621761 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.621718    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:11.622493 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.622478    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"
Sep 16 14:36:11.626724 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.626703    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-055ce3\""
Sep 16 14:36:11.626828 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.626739    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-055ce3-dockercfg-s78p7\""
Sep 16 14:36:11.637246 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.637210    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"]
Sep 16 14:36:11.712867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.712840    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:11.798114 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.798084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfmwz\" (UniqueName: \"kubernetes.io/projected/99e199df-ccb8-4225-8b9c-7afde24060ec-kube-api-access-xfmwz\") pod \"payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6\" (UID: \"99e199df-ccb8-4225-8b9c-7afde24060ec\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"
Sep 16 14:36:11.798251 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.798162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99e199df-ccb8-4225-8b9c-7afde24060ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6\" (UID: \"99e199df-ccb8-4225-8b9c-7afde24060ec\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"
Sep 16 14:36:11.899263 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.899163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfmwz\" (UniqueName: \"kubernetes.io/projected/99e199df-ccb8-4225-8b9c-7afde24060ec-kube-api-access-xfmwz\") pod \"payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6\" (UID: \"99e199df-ccb8-4225-8b9c-7afde24060ec\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"
Sep 16 14:36:11.899263 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.899216    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99e199df-ccb8-4225-8b9c-7afde24060ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6\" (UID: \"99e199df-ccb8-4225-8b9c-7afde24060ec\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"
Sep 16 14:36:11.899996 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.899976    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99e199df-ccb8-4225-8b9c-7afde24060ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6\" (UID: \"99e199df-ccb8-4225-8b9c-7afde24060ec\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"
Sep 16 14:36:11.911033 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.911009    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfmwz\" (UniqueName: \"kubernetes.io/projected/99e199df-ccb8-4225-8b9c-7afde24060ec-kube-api-access-xfmwz\") pod \"payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6\" (UID: \"99e199df-ccb8-4225-8b9c-7afde24060ec\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"
Sep 16 14:36:11.933576 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:11.933548    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"
Sep 16 14:36:12.028091 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:12.028054    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl" event={"ID":"2b7293cf-538e-43a9-b5db-dce81622ecb4","Type":"ContainerStarted","Data":"2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9"}
Sep 16 14:36:12.028264 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:12.028118    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl" event={"ID":"2b7293cf-538e-43a9-b5db-dce81622ecb4","Type":"ContainerStarted","Data":"05ae9d41eabed5c98ba21d39a453cb077f0b77e11899a03b877465526ac88c34"}
Sep 16 14:36:12.028264 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:12.028157    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:12.061074 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:12.061051    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:12.213749 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:12.213629    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl" podStartSLOduration=1.69787644 podStartE2EDuration="2.213607947s" totalImagesPullingTime="515.731507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:12.055120003 +0000 UTC m=+1291.348808482" watchObservedRunningTime="2026-09-16 14:36:12.213607947 +0000 UTC m=+1291.507296426"
Sep 16 14:36:12.216877 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:12.216855    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"]
Sep 16 14:36:12.218104 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:36:12.218080    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e199df_ccb8_4225_8b9c_7afde24060ec.slice/crio-69d7bf2ab4f580715bc91cba6ca101459b01f596a21a68f82c5b9ec2a4a50ee7 WatchSource:0}: Error finding container 69d7bf2ab4f580715bc91cba6ca101459b01f596a21a68f82c5b9ec2a4a50ee7: Status 404 returned error can't find the container with id 69d7bf2ab4f580715bc91cba6ca101459b01f596a21a68f82c5b9ec2a4a50ee7
Sep 16 14:36:13.034724 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:13.034690    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6" event={"ID":"99e199df-ccb8-4225-8b9c-7afde24060ec","Type":"ContainerStarted","Data":"69d7bf2ab4f580715bc91cba6ca101459b01f596a21a68f82c5b9ec2a4a50ee7"}
Sep 16 14:36:13.080000 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:13.079971    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:13.923211 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:13.923188    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:14.042463 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:14.042431    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6" event={"ID":"99e199df-ccb8-4225-8b9c-7afde24060ec","Type":"ContainerStarted","Data":"fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0"}
Sep 16 14:36:14.042834 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:14.042514    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"
Sep 16 14:36:14.064154 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:14.064106    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6" podStartSLOduration=1.431635091 podStartE2EDuration="3.064089528s" totalImagesPullingTime="1.632454437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:14.061968626 +0000 UTC m=+1293.355657105" watchObservedRunningTime="2026-09-16 14:36:14.064089528 +0000 UTC m=+1293.357778039"
Sep 16 14:36:15.016439 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:15.016399    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:18.040014 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:18.039983    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:36:18.951419 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:18.951375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:20.599930 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:20.599888    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:36:25.049987 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:25.049957    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"
Sep 16 14:36:27.045874 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:27.045840    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:31.005250 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:31.001735    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"]
Sep 16 14:36:31.044600 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:31.044569    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:33.227428 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:33.227395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:34.434437 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:34.434405    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:35.801718 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:35.801685    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:36.627499 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:36.627460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:37.415712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:37.415676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:37.690335 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:37.690226    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:38.815906 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:38.815869    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:40.098817 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:40.098783    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:41.051724 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:41.051689    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:43.521653 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:43.521622    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"]
Sep 16 14:36:43.614463 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:43.613687    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:46.025808 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.025762    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw" podUID="93a3baa5-6aed-49f4-a4b2-09b4c6333b3b" containerName="main" containerID="cri-o://0ed78cd5fa39e06b1e39cabf6ef299afd7bf5c4e935aadc39c89d15a6de074e6" gracePeriod=45
Sep 16 14:36:46.230438 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.230406    2582 generic.go:356] "Generic (PLEG): container finished" podID="93a3baa5-6aed-49f4-a4b2-09b4c6333b3b" containerID="0ed78cd5fa39e06b1e39cabf6ef299afd7bf5c4e935aadc39c89d15a6de074e6" exitCode=0
Sep 16 14:36:46.230597 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.230433    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw" event={"ID":"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b","Type":"ContainerDied","Data":"0ed78cd5fa39e06b1e39cabf6ef299afd7bf5c4e935aadc39c89d15a6de074e6"}
Sep 16 14:36:46.281975 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.281923    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:36:46.446306 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.446276    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-dshm\") pod \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") "
Sep 16 14:36:46.446461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.446348    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-tmp-dir\") pod \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") "
Sep 16 14:36:46.446461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.446396    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-home\") pod \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") "
Sep 16 14:36:46.446548 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.446468    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-tls-certs\") pod \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") "
Sep 16 14:36:46.446548 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.446505    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqn6z\" (UniqueName: \"kubernetes.io/projected/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-kube-api-access-rqn6z\") pod \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") "
Sep 16 14:36:46.446548 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.446537    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-model-cache\") pod \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\" (UID: \"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b\") "
Sep 16 14:36:46.446697 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.446655    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "93a3baa5-6aed-49f4-a4b2-09b4c6333b3b" (UID: "93a3baa5-6aed-49f4-a4b2-09b4c6333b3b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:36:46.446697 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.446679    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-home" (OuterVolumeSpecName: "home") pod "93a3baa5-6aed-49f4-a4b2-09b4c6333b3b" (UID: "93a3baa5-6aed-49f4-a4b2-09b4c6333b3b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:36:46.446888 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.446862    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-model-cache" (OuterVolumeSpecName: "model-cache") pod "93a3baa5-6aed-49f4-a4b2-09b4c6333b3b" (UID: "93a3baa5-6aed-49f4-a4b2-09b4c6333b3b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:36:46.446950 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.446937    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-tmp-dir\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:36:46.446986 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.446957    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-home\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:36:46.448578 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.448548    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-dshm" (OuterVolumeSpecName: "dshm") pod "93a3baa5-6aed-49f4-a4b2-09b4c6333b3b" (UID: "93a3baa5-6aed-49f4-a4b2-09b4c6333b3b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:36:46.448677 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.448602    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "93a3baa5-6aed-49f4-a4b2-09b4c6333b3b" (UID: "93a3baa5-6aed-49f4-a4b2-09b4c6333b3b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:36:46.448677 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.448618    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-kube-api-access-rqn6z" (OuterVolumeSpecName: "kube-api-access-rqn6z") pod "93a3baa5-6aed-49f4-a4b2-09b4c6333b3b" (UID: "93a3baa5-6aed-49f4-a4b2-09b4c6333b3b"). InnerVolumeSpecName "kube-api-access-rqn6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:36:46.548334 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.548305    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-tls-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:36:46.548334 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.548330    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqn6z\" (UniqueName: \"kubernetes.io/projected/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-kube-api-access-rqn6z\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:36:46.548488 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.548339    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-model-cache\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:36:46.548488 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:46.548348    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b-dshm\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:36:47.237915 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:47.237882    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"
Sep 16 14:36:47.237915 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:47.237894    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw" event={"ID":"93a3baa5-6aed-49f4-a4b2-09b4c6333b3b","Type":"ContainerDied","Data":"86bd039c5cd1d9e3ae9aea20eb6a6ca6f060ed1239b218406f493663e9730a4c"}
Sep 16 14:36:47.238393 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:47.237944    2582 scope.go:117] "RemoveContainer" containerID="0ed78cd5fa39e06b1e39cabf6ef299afd7bf5c4e935aadc39c89d15a6de074e6"
Sep 16 14:36:47.279244 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:47.279217    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"]
Sep 16 14:36:47.292178 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:47.292146    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/e2e-conflict-a-0e827697-kserve-7c7b6f7565-xslfw"]
Sep 16 14:36:49.180340 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:49.180302    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93a3baa5-6aed-49f4-a4b2-09b4c6333b3b" path="/var/lib/kubelet/pods/93a3baa5-6aed-49f4-a4b2-09b4c6333b3b/volumes"
Sep 16 14:36:58.540453 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.540384    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh" podUID="0b5f1fb4-96c0-4a23-9d16-0b83307fea01" containerName="main" containerID="cri-o://30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27" gracePeriod=45
Sep 16 14:36:58.629040 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.629002    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:36:58.798472 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.798419    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:36:58.859839 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.859806    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9jzl\" (UniqueName: \"kubernetes.io/projected/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-kube-api-access-k9jzl\") pod \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") "
Sep 16 14:36:58.859988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.859876    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-home\") pod \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") "
Sep 16 14:36:58.860033 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.859987    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-dshm\") pod \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") "
Sep 16 14:36:58.860071 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.860047    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-tls-certs\") pod \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") "
Sep 16 14:36:58.860150 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.860128    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-home" (OuterVolumeSpecName: "home") pod "0b5f1fb4-96c0-4a23-9d16-0b83307fea01" (UID: "0b5f1fb4-96c0-4a23-9d16-0b83307fea01"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:36:58.860213 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.860138    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-model-cache\") pod \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") "
Sep 16 14:36:58.860213 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.860205    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-tmp-dir\") pod \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\" (UID: \"0b5f1fb4-96c0-4a23-9d16-0b83307fea01\") "
Sep 16 14:36:58.860423 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.860396    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-model-cache" (OuterVolumeSpecName: "model-cache") pod "0b5f1fb4-96c0-4a23-9d16-0b83307fea01" (UID: "0b5f1fb4-96c0-4a23-9d16-0b83307fea01"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:36:58.860548 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.860446    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0b5f1fb4-96c0-4a23-9d16-0b83307fea01" (UID: "0b5f1fb4-96c0-4a23-9d16-0b83307fea01"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:36:58.860675 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.860654    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-tmp-dir\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:36:58.860727 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.860680    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-home\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:36:58.860727 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.860694    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-model-cache\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:36:58.862147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.862125    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0b5f1fb4-96c0-4a23-9d16-0b83307fea01" (UID: "0b5f1fb4-96c0-4a23-9d16-0b83307fea01"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:36:58.862259 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.862158    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-dshm" (OuterVolumeSpecName: "dshm") pod "0b5f1fb4-96c0-4a23-9d16-0b83307fea01" (UID: "0b5f1fb4-96c0-4a23-9d16-0b83307fea01"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:36:58.862259 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.862165    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-kube-api-access-k9jzl" (OuterVolumeSpecName: "kube-api-access-k9jzl") pod "0b5f1fb4-96c0-4a23-9d16-0b83307fea01" (UID: "0b5f1fb4-96c0-4a23-9d16-0b83307fea01"). InnerVolumeSpecName "kube-api-access-k9jzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:36:58.961712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.961688    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9jzl\" (UniqueName: \"kubernetes.io/projected/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-kube-api-access-k9jzl\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:36:58.961712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.961711    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-dshm\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:36:58.961870 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:58.961721    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b5f1fb4-96c0-4a23-9d16-0b83307fea01-tls-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:36:59.307592 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:59.307542    2582 generic.go:356] "Generic (PLEG): container finished" podID="0b5f1fb4-96c0-4a23-9d16-0b83307fea01" containerID="30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27" exitCode=0
Sep 16 14:36:59.307592 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:59.307584    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"
Sep 16 14:36:59.307765 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:59.307624    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh" event={"ID":"0b5f1fb4-96c0-4a23-9d16-0b83307fea01","Type":"ContainerDied","Data":"30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27"}
Sep 16 14:36:59.307765 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:59.307663    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh" event={"ID":"0b5f1fb4-96c0-4a23-9d16-0b83307fea01","Type":"ContainerDied","Data":"3963c253d8b715192a5207a21cfbe76f24cf33ca14ea0fbad87b99ac378dfa98"}
Sep 16 14:36:59.307765 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:59.307680    2582 scope.go:117] "RemoveContainer" containerID="30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27"
Sep 16 14:36:59.316945 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:59.316923    2582 scope.go:117] "RemoveContainer" containerID="30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27"
Sep 16 14:36:59.317208 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:36:59.317186    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27\": container with ID starting with 30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27 not found: ID does not exist" containerID="30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27"
Sep 16 14:36:59.317293 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:59.317215    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27"} err="failed to get container status \"30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27\": rpc error: code = NotFound desc = could not find container \"30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27\": container with ID starting with 30dda23c8a9e8a704a16e786b3234e5fa70b93d1f3f24f88e0c09bd7adb58c27 not found: ID does not exist"
Sep 16 14:36:59.332125 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:59.332102    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"]
Sep 16 14:36:59.338989 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:36:59.338971    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/e2e-conflict-b-0e827697-kserve-dd7df45d7-8f7fh"]
Sep 16 14:37:00.242751 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.242715    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"]
Sep 16 14:37:00.243220 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.243158    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93a3baa5-6aed-49f4-a4b2-09b4c6333b3b" containerName="main"
Sep 16 14:37:00.243220 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.243170    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="93a3baa5-6aed-49f4-a4b2-09b4c6333b3b" containerName="main"
Sep 16 14:37:00.243220 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.243184    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b5f1fb4-96c0-4a23-9d16-0b83307fea01" containerName="main"
Sep 16 14:37:00.243220 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.243189    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b5f1fb4-96c0-4a23-9d16-0b83307fea01" containerName="main"
Sep 16 14:37:00.243401 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.243264    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b5f1fb4-96c0-4a23-9d16-0b83307fea01" containerName="main"
Sep 16 14:37:00.243401 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.243276    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="93a3baa5-6aed-49f4-a4b2-09b4c6333b3b" containerName="main"
Sep 16 14:37:00.247633 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.247616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.251802 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.251767    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-9f88e1\"/\"openshift-service-ca.crt\""
Sep 16 14:37:00.251937 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.251872    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-9f88e1\"/\"default-dockercfg-lt7qm\""
Sep 16 14:37:00.251937 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.251889    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-9f88e1\"/\"auth-test-model-9f88e1-kserve-self-signed-certs\""
Sep 16 14:37:00.251937 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.251872    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-9f88e1\"/\"kube-root-ca.crt\""
Sep 16 14:37:00.264199 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.264173    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"]
Sep 16 14:37:00.273340 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.273320    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-home\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.273438 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.273350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-model-cache\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.273438 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.273388    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-dshm\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.273515 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.273442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-tmp-dir\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.273515 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.273481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-tls-certs\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.273580 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.273528    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5h4r\" (UniqueName: \"kubernetes.io/projected/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-kube-api-access-r5h4r\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.304292 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.304259    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:00.375180 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.375139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-home\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.377541 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.377503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-model-cache\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.377708 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.377571    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-dshm\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.377708 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.377627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-tmp-dir\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.377708 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.377653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-tls-certs\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.377708 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.377696    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5h4r\" (UniqueName: \"kubernetes.io/projected/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-kube-api-access-r5h4r\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.378328 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.377418    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-home\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.378690 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.378669    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-model-cache\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.378975 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.378940    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-tmp-dir\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.381555 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.381512    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-dshm\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.381789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.381744    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-tls-certs\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.391799 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.391732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5h4r\" (UniqueName: \"kubernetes.io/projected/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-kube-api-access-r5h4r\") pod \"auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.556895 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.556865    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:00.840642 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:00.840617    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"]
Sep 16 14:37:00.841851 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:37:00.841823    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ce32a5c_de8e_4bbe_ad9c_50276d1acfa9.slice/crio-d110b9104c42ad7f586403bcf0631e076f1e6aaedb3b01f9d9fea15bb3ef3d00 WatchSource:0}: Error finding container d110b9104c42ad7f586403bcf0631e076f1e6aaedb3b01f9d9fea15bb3ef3d00: Status 404 returned error can't find the container with id d110b9104c42ad7f586403bcf0631e076f1e6aaedb3b01f9d9fea15bb3ef3d00
Sep 16 14:37:01.182296 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:01.182212    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b5f1fb4-96c0-4a23-9d16-0b83307fea01" path="/var/lib/kubelet/pods/0b5f1fb4-96c0-4a23-9d16-0b83307fea01/volumes"
Sep 16 14:37:01.321673 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:01.321631    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6" event={"ID":"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9","Type":"ContainerStarted","Data":"67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb"}
Sep 16 14:37:01.321673 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:01.321674    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6" event={"ID":"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9","Type":"ContainerStarted","Data":"d110b9104c42ad7f586403bcf0631e076f1e6aaedb3b01f9d9fea15bb3ef3d00"}
Sep 16 14:37:01.344382 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:01.344336    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6" podStartSLOduration=1.344322236 podStartE2EDuration="1.344322236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:37:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:37:01.343257725 +0000 UTC m=+1340.636946205" watchObservedRunningTime="2026-09-16 14:37:01.344322236 +0000 UTC m=+1340.638010714"
Sep 16 14:37:10.557174 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:10.557136    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:10.557671 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:10.557199    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:10.569457 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:10.569433    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:11.392051 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:11.392020    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:37:15.610440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.610398    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"]
Sep 16 14:37:15.615021 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.614998    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.618831 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.618784    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5d484d\"/\"kube-root-ca.crt\""
Sep 16 14:37:15.618831 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.618793    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5d484d\"/\"distinct-w4-5d484d-kserve-self-signed-certs\""
Sep 16 14:37:15.618831 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.618806    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5d484d\"/\"default-dockercfg-vdgm5\""
Sep 16 14:37:15.619081 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.618976    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5d484d\"/\"openshift-service-ca.crt\""
Sep 16 14:37:15.625321 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.625299    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"]
Sep 16 14:37:15.642625 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.642602    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:15.719781 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.719755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl8h6\" (UniqueName: \"kubernetes.io/projected/35a2abc4-3289-419b-94ef-698b10d96441-kube-api-access-bl8h6\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.719881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.719830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-home\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.719881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.719849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35a2abc4-3289-419b-94ef-698b10d96441-tls-certs\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.719881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.719876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-model-cache\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.719991 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.719933    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-dshm\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.720026 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.719990    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-tmp-dir\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.821297 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.821231    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-home\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.821297 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.821297    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35a2abc4-3289-419b-94ef-698b10d96441-tls-certs\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.821512 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.821328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-model-cache\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.821512 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.821359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-dshm\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.821512 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.821385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-tmp-dir\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.821512 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.821466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl8h6\" (UniqueName: \"kubernetes.io/projected/35a2abc4-3289-419b-94ef-698b10d96441-kube-api-access-bl8h6\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.821711 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.821687    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-home\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.821766 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.821736    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-model-cache\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.821841 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.821810    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-tmp-dir\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.823728 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.823705    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-dshm\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.823921 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.823904    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35a2abc4-3289-419b-94ef-698b10d96441-tls-certs\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.835148 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.835124    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl8h6\" (UniqueName: \"kubernetes.io/projected/35a2abc4-3289-419b-94ef-698b10d96441-kube-api-access-bl8h6\") pod \"distinct-w4-5d484d-kserve-6897c7f77d-mbghv\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") " pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:15.925879 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:15.925820    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:16.203687 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:16.203662    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"]
Sep 16 14:37:16.204472 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:37:16.204450    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35a2abc4_3289_419b_94ef_698b10d96441.slice/crio-43b0f0c180e73b6892491ec920e71694edab0b3290a442a1d5143408af0ac679 WatchSource:0}: Error finding container 43b0f0c180e73b6892491ec920e71694edab0b3290a442a1d5143408af0ac679: Status 404 returned error can't find the container with id 43b0f0c180e73b6892491ec920e71694edab0b3290a442a1d5143408af0ac679
Sep 16 14:37:16.412846 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:16.412810    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv" event={"ID":"35a2abc4-3289-419b-94ef-698b10d96441","Type":"ContainerStarted","Data":"c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177"}
Sep 16 14:37:16.412846 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:16.412852    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv" event={"ID":"35a2abc4-3289-419b-94ef-698b10d96441","Type":"ContainerStarted","Data":"43b0f0c180e73b6892491ec920e71694edab0b3290a442a1d5143408af0ac679"}
Sep 16 14:37:16.441185 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:16.441141    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv" podStartSLOduration=1.44112194 podStartE2EDuration="1.44112194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:37:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:37:16.44009723 +0000 UTC m=+1355.733785709" watchObservedRunningTime="2026-09-16 14:37:16.44112194 +0000 UTC m=+1355.734810421"
Sep 16 14:37:22.924570 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:22.924530    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:23.771305 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:23.771274    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:24.305406 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:24.305378    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:25.207187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:25.207149    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:25.907870 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:25.907837    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:25.926286 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:25.926261    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:25.926401 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:25.926320    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:25.939009 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:25.938984    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:26.479652 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:26.479618    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:37:26.645962 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:26.645934    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:27.720870 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:27.720837    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:28.931614 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:28.931567    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:29.776255 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:29.776208    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:31.614894 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:31.614860    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:37:38.162710 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:38.162677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:38.264875 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:38.264843    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:38.362801 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:38.362770    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:38.464828 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:38.464743    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:38.837635 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:38.837588    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:39.623044 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:39.623017    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:40.507116 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:40.507085    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:41.403901 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:41.403873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:41.594596 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:41.594563    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:42.052848 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:42.052815    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:42.832387 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:42.832356    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:43.528374 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:43.528344    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:46.673766 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:46.673734    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:50.763715 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:50.763685    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:51.713662 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:37:51.713626    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:02.515337 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:02.515303    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:38:04.436604 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:04.436566    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:22.929250 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:22.929211    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:24.040225 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:24.040189    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:31.410317 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:31.410278    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:33.520208 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:33.520175    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:38:36.890774 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:36.890738    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:46.491361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:46.491325    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:46.593302 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:46.593270    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:46.831051 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:46.831011    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:47.811762 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.811722    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"]
Sep 16 14:38:47.816154 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.816134    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:47.820103 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.820068    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-924916\"/\"embedding-w0-924916-kserve-self-signed-certs\""
Sep 16 14:38:47.820103 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.820088    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-924916\"/\"openshift-service-ca.crt\""
Sep 16 14:38:47.820339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.820182    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-924916\"/\"default-dockercfg-xgs7f\""
Sep 16 14:38:47.820339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.820222    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-924916\"/\"kube-root-ca.crt\""
Sep 16 14:38:47.824569 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.824538    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"]
Sep 16 14:38:47.918445 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.918399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-model-cache\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:47.918626 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.918451    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkd88\" (UniqueName: \"kubernetes.io/projected/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-kube-api-access-pkd88\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:47.918626 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.918544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-dshm\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:47.918626 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.918603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-tmp-dir\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:47.918995 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.918661    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-home\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:47.918995 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.918721    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-tls-certs\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:47.929401 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:47.929366    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:48.020281 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.020226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-tls-certs\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.021092 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.021065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-model-cache\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.021295 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.021276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkd88\" (UniqueName: \"kubernetes.io/projected/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-kube-api-access-pkd88\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.021458 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.021443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-dshm\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.021633 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.021616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-tmp-dir\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.021816 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.021503    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-model-cache\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.022293 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.021800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-home\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.022472 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.022435    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-tmp-dir\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.022630 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.022118    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-home\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.032297 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.024919    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-dshm\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.032297 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.032122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkd88\" (UniqueName: \"kubernetes.io/projected/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-kube-api-access-pkd88\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.033554 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.033529    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-tls-certs\") pod \"embedding-w0-924916-kserve-b8f686889-5c5md\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") " pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.129385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.129288    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:48.270462 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.270430    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:48.387599 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.387520    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:48.411680 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.411656    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"]
Sep 16 14:38:48.413971 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:38:48.413931    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebfe1b07_d3c9_4cc5_bc49_d97667cb3526.slice/crio-9e145fda3c72962eb5de79c185718887ede4b5741a32044512dea394e2457449 WatchSource:0}: Error finding container 9e145fda3c72962eb5de79c185718887ede4b5741a32044512dea394e2457449: Status 404 returned error can't find the container with id 9e145fda3c72962eb5de79c185718887ede4b5741a32044512dea394e2457449
Sep 16 14:38:48.514269 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.514228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:48.657422 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.657332    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:48.952914 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.952818    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md" event={"ID":"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526","Type":"ContainerStarted","Data":"42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2"}
Sep 16 14:38:48.952914 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:48.952865    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md" event={"ID":"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526","Type":"ContainerStarted","Data":"9e145fda3c72962eb5de79c185718887ede4b5741a32044512dea394e2457449"}
Sep 16 14:38:49.168646 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:49.168612    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:49.254918 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:49.254208    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:49.361482 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:49.361439    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:50.788653 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:50.788618    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:57.357338 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:57.357285    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:57.428632 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:57.428601    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:58.129801 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:58.129765    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:58.129992 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:58.129847    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:58.141767 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:58.141747    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:58.162161 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:58.162112    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md" podStartSLOduration=11.162098732 podStartE2EDuration="11.162098732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:38:49.008017041 +0000 UTC m=+1448.301705519" watchObservedRunningTime="2026-09-16 14:38:58.162098732 +0000 UTC m=+1457.455787211"
Sep 16 14:38:59.022380 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:59.022347    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:38:59.931392 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:38:59.931356    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:39:03.513284 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:39:03.513246    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:04.838285 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:39:04.838217    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:23.968882 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:39:23.968842    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:26.218004 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:39:26.217954    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:39:27.153707 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:39:27.153668    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:29.182918 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:39:29.182887    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:29.296724 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:39:29.296694    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:29.453159 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:39:29.453082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:39.910308 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:39:39.910228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:40.124610 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:39:40.124577    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:52.214757 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:39:52.214719    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:40:00.506689 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:00.506655    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:02.591490 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:02.591458    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:03.599947 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:03.599914    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:04.490694 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:04.490658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:05.117263 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:05.117200    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:05.358862 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:05.358827    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"]
Sep 16 14:40:05.452123 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:05.452025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:05.886270 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:05.886223    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:06.732536 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:06.732498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:08.004891 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:08.004848    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:08.146568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:08.146526    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:08.248466 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:08.248438    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:08.476135 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:08.476080    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:08.767126 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:08.767037    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:09.069640 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:09.069606    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:11.611161 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:11.611104    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:12.243803 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:12.243759    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:12.343475 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:12.343438    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:12.481217 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:12.481170    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:13.252632 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:13.252596    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:14.211992 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:14.211959    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:14.945748 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:14.945698    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:15.677476 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:15.677413    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:16.526439 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:16.526393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:16.628153 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:16.628109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:16.982657 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:16.982623    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:17.120481 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.120444    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"]
Sep 16 14:40:17.123971 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.123955    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"
Sep 16 14:40:17.128677 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.128653    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"]
Sep 16 14:40:17.131872 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.131853    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"
Sep 16 14:40:17.132372 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.132352    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-71d83f\""
Sep 16 14:40:17.134413 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.134391    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-71d83f-dockercfg-7rxzh\""
Sep 16 14:40:17.144150 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.144125    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"]
Sep 16 14:40:17.150828 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.150802    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"]
Sep 16 14:40:17.151458 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.151434    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:17.183819 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.183782    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942\" (UID: \"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"
Sep 16 14:40:17.183975 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.183830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-549wt\" (UniqueName: \"kubernetes.io/projected/72b2f75e-f06b-453a-a4d8-61528a5d4934-kube-api-access-549wt\") pod \"payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw\" (UID: \"72b2f75e-f06b-453a-a4d8-61528a5d4934\") " pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"
Sep 16 14:40:17.183975 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.183887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b2f75e-f06b-453a-a4d8-61528a5d4934-plugins-config-volume\") pod \"payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw\" (UID: \"72b2f75e-f06b-453a-a4d8-61528a5d4934\") " pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"
Sep 16 14:40:17.183975 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.183913    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs66m\" (UniqueName: \"kubernetes.io/projected/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419-kube-api-access-cs66m\") pod \"payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942\" (UID: \"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"
Sep 16 14:40:17.287786 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.287745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942\" (UID: \"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"
Sep 16 14:40:17.288651 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.288615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-549wt\" (UniqueName: \"kubernetes.io/projected/72b2f75e-f06b-453a-a4d8-61528a5d4934-kube-api-access-549wt\") pod \"payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw\" (UID: \"72b2f75e-f06b-453a-a4d8-61528a5d4934\") " pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"
Sep 16 14:40:17.288788 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.288704    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b2f75e-f06b-453a-a4d8-61528a5d4934-plugins-config-volume\") pod \"payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw\" (UID: \"72b2f75e-f06b-453a-a4d8-61528a5d4934\") " pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"
Sep 16 14:40:17.288788 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.288748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs66m\" (UniqueName: \"kubernetes.io/projected/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419-kube-api-access-cs66m\") pod \"payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942\" (UID: \"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"
Sep 16 14:40:17.289886 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.289863    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b2f75e-f06b-453a-a4d8-61528a5d4934-plugins-config-volume\") pod \"payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw\" (UID: \"72b2f75e-f06b-453a-a4d8-61528a5d4934\") " pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"
Sep 16 14:40:17.290469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.290449    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942\" (UID: \"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"
Sep 16 14:40:17.299289 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.299203    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs66m\" (UniqueName: \"kubernetes.io/projected/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419-kube-api-access-cs66m\") pod \"payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942\" (UID: \"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"
Sep 16 14:40:17.299969 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.299467    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-549wt\" (UniqueName: \"kubernetes.io/projected/72b2f75e-f06b-453a-a4d8-61528a5d4934-kube-api-access-549wt\") pod \"payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw\" (UID: \"72b2f75e-f06b-453a-a4d8-61528a5d4934\") " pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"
Sep 16 14:40:17.435491 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.435456    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"
Sep 16 14:40:17.444502 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.444478    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"
Sep 16 14:40:17.507624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.507507    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:17.733847 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.733818    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"]
Sep 16 14:40:17.735154 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:40:17.735124    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1f8250_0d2c_4a51_b9c3_7fd5120b4419.slice/crio-b572378c36f7638cc6be89e01b9ab726438af4a2f23cba2df602341d2d540d67 WatchSource:0}: Error finding container b572378c36f7638cc6be89e01b9ab726438af4a2f23cba2df602341d2d540d67: Status 404 returned error can't find the container with id b572378c36f7638cc6be89e01b9ab726438af4a2f23cba2df602341d2d540d67
Sep 16 14:40:17.754487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:17.754466    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"]
Sep 16 14:40:17.755293 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:40:17.755267    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b2f75e_f06b_453a_a4d8_61528a5d4934.slice/crio-a881f4c2a45b1eeda229e7317f92d141ec9e556d557c656a0f358d10d1eb9c71 WatchSource:0}: Error finding container a881f4c2a45b1eeda229e7317f92d141ec9e556d557c656a0f358d10d1eb9c71: Status 404 returned error can't find the container with id a881f4c2a45b1eeda229e7317f92d141ec9e556d557c656a0f358d10d1eb9c71
Sep 16 14:40:18.202309 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:18.202207    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:18.508298 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:18.508185    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942" event={"ID":"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419","Type":"ContainerStarted","Data":"77ce3a10240da93408e79a3de40f4f9421cd7f0fc463c3291252bc3295a06a69"}
Sep 16 14:40:18.508298 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:18.508265    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"
Sep 16 14:40:18.508298 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:18.508293    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942" event={"ID":"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419","Type":"ContainerStarted","Data":"b572378c36f7638cc6be89e01b9ab726438af4a2f23cba2df602341d2d540d67"}
Sep 16 14:40:18.510095 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:18.510069    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw" event={"ID":"72b2f75e-f06b-453a-a4d8-61528a5d4934","Type":"ContainerStarted","Data":"fdcb58b958eea5f0778c490abd1ea978e00f5d37490bc51893ab3d1695005762"}
Sep 16 14:40:18.510232 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:18.510112    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw" event={"ID":"72b2f75e-f06b-453a-a4d8-61528a5d4934","Type":"ContainerStarted","Data":"a881f4c2a45b1eeda229e7317f92d141ec9e556d557c656a0f358d10d1eb9c71"}
Sep 16 14:40:18.510232 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:18.510158    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"
Sep 16 14:40:18.526351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:18.526300    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942" podStartSLOduration=1.526281115 podStartE2EDuration="1.526281115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:40:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:40:18.526068628 +0000 UTC m=+1537.819757110" watchObservedRunningTime="2026-09-16 14:40:18.526281115 +0000 UTC m=+1537.819969595"
Sep 16 14:40:18.549260 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:18.546328    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw" podStartSLOduration=1.5463081029999999 podStartE2EDuration="1.546308103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:40:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:40:18.543307147 +0000 UTC m=+1537.836995625" watchObservedRunningTime="2026-09-16 14:40:18.546308103 +0000 UTC m=+1537.839996582"
Sep 16 14:40:18.819950 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:18.819912    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:19.896036 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:19.896004    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:20.432646 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.432596    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md" podUID="ebfe1b07-d3c9-4cc5-bc49-d97667cb3526" containerName="main" containerID="cri-o://42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2" gracePeriod=45
Sep 16 14:40:20.696371 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.696295    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:40:20.826016 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.825982    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-model-cache\") pod \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") "
Sep 16 14:40:20.826159 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.826048    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-tls-certs\") pod \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") "
Sep 16 14:40:20.826159 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.826092    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkd88\" (UniqueName: \"kubernetes.io/projected/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-kube-api-access-pkd88\") pod \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") "
Sep 16 14:40:20.826159 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.826131    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-tmp-dir\") pod \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") "
Sep 16 14:40:20.826359 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.826184    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-dshm\") pod \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") "
Sep 16 14:40:20.826359 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.826268    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-home\") pod \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\" (UID: \"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526\") "
Sep 16 14:40:20.826359 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.826331    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-model-cache" (OuterVolumeSpecName: "model-cache") pod "ebfe1b07-d3c9-4cc5-bc49-d97667cb3526" (UID: "ebfe1b07-d3c9-4cc5-bc49-d97667cb3526"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:20.826525 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.826425    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ebfe1b07-d3c9-4cc5-bc49-d97667cb3526" (UID: "ebfe1b07-d3c9-4cc5-bc49-d97667cb3526"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:20.826636 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.826606    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-home" (OuterVolumeSpecName: "home") pod "ebfe1b07-d3c9-4cc5-bc49-d97667cb3526" (UID: "ebfe1b07-d3c9-4cc5-bc49-d97667cb3526"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:20.826769 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.826709    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-model-cache\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:20.826769 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.826725    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-tmp-dir\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:20.826769 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.826732    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-home\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:20.828328 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.828304    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ebfe1b07-d3c9-4cc5-bc49-d97667cb3526" (UID: "ebfe1b07-d3c9-4cc5-bc49-d97667cb3526"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:40:20.828415 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.828321    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-dshm" (OuterVolumeSpecName: "dshm") pod "ebfe1b07-d3c9-4cc5-bc49-d97667cb3526" (UID: "ebfe1b07-d3c9-4cc5-bc49-d97667cb3526"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:20.828415 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.828369    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-kube-api-access-pkd88" (OuterVolumeSpecName: "kube-api-access-pkd88") pod "ebfe1b07-d3c9-4cc5-bc49-d97667cb3526" (UID: "ebfe1b07-d3c9-4cc5-bc49-d97667cb3526"). InnerVolumeSpecName "kube-api-access-pkd88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:40:20.928207 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.928160    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkd88\" (UniqueName: \"kubernetes.io/projected/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-kube-api-access-pkd88\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:20.928207 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.928199    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-dshm\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:20.928207 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:20.928209    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526-tls-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:21.216159 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.216128    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"]
Sep 16 14:40:21.216441 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.216414    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q" podUID="d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5" containerName="maas-api" containerID="cri-o://e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569" gracePeriod=30
Sep 16 14:40:21.250465 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.250386    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:21.393451 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.393418    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:21.534147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.534109    2582 generic.go:356] "Generic (PLEG): container finished" podID="ebfe1b07-d3c9-4cc5-bc49-d97667cb3526" containerID="42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2" exitCode=0
Sep 16 14:40:21.534351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.534185    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md" event={"ID":"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526","Type":"ContainerDied","Data":"42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2"}
Sep 16 14:40:21.534351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.534223    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md" event={"ID":"ebfe1b07-d3c9-4cc5-bc49-d97667cb3526","Type":"ContainerDied","Data":"9e145fda3c72962eb5de79c185718887ede4b5741a32044512dea394e2457449"}
Sep 16 14:40:21.534351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.534252    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"
Sep 16 14:40:21.534351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.534259    2582 scope.go:117] "RemoveContainer" containerID="42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2"
Sep 16 14:40:21.561271 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.561214    2582 scope.go:117] "RemoveContainer" containerID="42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2"
Sep 16 14:40:21.561884 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:40:21.561842    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2\": container with ID starting with 42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2 not found: ID does not exist" containerID="42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2"
Sep 16 14:40:21.562010 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.561901    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2"} err="failed to get container status \"42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2\": rpc error: code = NotFound desc = could not find container \"42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2\": container with ID starting with 42de8f3a2523d893777f10ac6655d3a1217b990cfe1a615fda4a1a0b87eb05f2 not found: ID does not exist"
Sep 16 14:40:21.586625 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.586511    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"]
Sep 16 14:40:21.590946 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.590919    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-924916/embedding-w0-924916-kserve-b8f686889-5c5md"]
Sep 16 14:40:21.603815 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.603778    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:21.709526 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.709506    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:40:21.836582 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.836554    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbgq9\" (UniqueName: \"kubernetes.io/projected/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-kube-api-access-mbgq9\") pod \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") "
Sep 16 14:40:21.836783 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.836610    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-openshift-service-ca\") pod \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") "
Sep 16 14:40:21.836783 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.836653    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-metrics-certs\") pod \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") "
Sep 16 14:40:21.836783 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.836772    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-maas-api-tls\") pod \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\" (UID: \"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5\") "
Sep 16 14:40:21.837036 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.837005    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5" (UID: "d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:40:21.838715 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.838691    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-kube-api-access-mbgq9" (OuterVolumeSpecName: "kube-api-access-mbgq9") pod "d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5" (UID: "d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5"). InnerVolumeSpecName "kube-api-access-mbgq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:40:21.838825 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.838710    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5" (UID: "d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:40:21.838825 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.838772    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5" (UID: "d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:40:21.861060 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.861031    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:21.938632 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.938601    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:21.938632 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.938628    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbgq9\" (UniqueName: \"kubernetes.io/projected/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-kube-api-access-mbgq9\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:21.938993 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.938640    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:21.938993 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:21.938655    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:22.014760 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:22.014729    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:22.542066 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:22.542037    2582 generic.go:356] "Generic (PLEG): container finished" podID="d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5" containerID="e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569" exitCode=0
Sep 16 14:40:22.542230 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:22.542090    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"
Sep 16 14:40:22.542230 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:22.542134    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q" event={"ID":"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5","Type":"ContainerDied","Data":"e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569"}
Sep 16 14:40:22.542230 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:22.542180    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q" event={"ID":"d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5","Type":"ContainerDied","Data":"9911bc7f0862ed64477d978c426552f106cd683c91318732e89ae342c2d01a2a"}
Sep 16 14:40:22.542230 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:22.542211    2582 scope.go:117] "RemoveContainer" containerID="e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569"
Sep 16 14:40:22.552217 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:22.552202    2582 scope.go:117] "RemoveContainer" containerID="e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569"
Sep 16 14:40:22.552513 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:40:22.552494    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569\": container with ID starting with e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569 not found: ID does not exist" containerID="e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569"
Sep 16 14:40:22.552567 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:22.552521    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569"} err="failed to get container status \"e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569\": rpc error: code = NotFound desc = could not find container \"e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569\": container with ID starting with e545ef08b1949568c256f3330b51dafc2f2db6305d0d173615c3520b97a38569 not found: ID does not exist"
Sep 16 14:40:22.566007 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:22.565983    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"]
Sep 16 14:40:22.570164 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:22.570144    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-924916-8444f76f79-4df4q"]
Sep 16 14:40:22.743407 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:22.743372    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:23.181638 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:23.181603    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5" path="/var/lib/kubelet/pods/d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5/volumes"
Sep 16 14:40:23.182088 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:23.182072    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebfe1b07-d3c9-4cc5-bc49-d97667cb3526" path="/var/lib/kubelet/pods/ebfe1b07-d3c9-4cc5-bc49-d97667cb3526/volumes"
Sep 16 14:40:23.401288 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:23.401254    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:24.296251 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:24.296173    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:25.071534 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:25.071500    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:25.859148 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:25.859108    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:26.916036 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:26.916000    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:28.438650 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:28.438620    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:29.027448 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:29.027419    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:29.128767 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:29.128726    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:29.233767 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:29.233739    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:29.310016 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:29.309981    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"]
Sep 16 14:40:29.310280 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:29.310248    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy" containerID="cri-o://747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015" gracePeriod=30
Sep 16 14:40:29.334031 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:29.333985    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:29.517939 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:29.517905    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"
Sep 16 14:40:29.518398 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:29.518000    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"
Sep 16 14:40:30.336369 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:30.336329    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:31.641609 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:31.641578    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:32.130057 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:32.130012    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:40:32.412979 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:32.412889    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:32.685939 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:32.685848    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:32.841466 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:32.841429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:33.273105 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:33.273071    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:33.555399 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:33.555362    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:33.745023 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:33.744991    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:34.272588 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.272543    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:34.568535 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.568512    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:40:34.615415 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.615380    2582 generic.go:356] "Generic (PLEG): container finished" podID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerID="747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015" exitCode=0
Sep 16 14:40:34.615561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.615445    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"
Sep 16 14:40:34.615561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.615462    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" event={"ID":"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e","Type":"ContainerDied","Data":"747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015"}
Sep 16 14:40:34.615561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.615514    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj" event={"ID":"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e","Type":"ContainerDied","Data":"70043d80c92005b51c413b8daf388acd9d4a0b32ea29db1188540675ec22ee67"}
Sep 16 14:40:34.615561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.615542    2582 scope.go:117] "RemoveContainer" containerID="747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015"
Sep 16 14:40:34.637699 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.637664    2582 scope.go:117] "RemoveContainer" containerID="ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07"
Sep 16 14:40:34.647733 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.647712    2582 scope.go:117] "RemoveContainer" containerID="747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015"
Sep 16 14:40:34.648029 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:40:34.648009    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015\": container with ID starting with 747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015 not found: ID does not exist" containerID="747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015"
Sep 16 14:40:34.648106 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.648043    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015"} err="failed to get container status \"747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015\": rpc error: code = NotFound desc = could not find container \"747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015\": container with ID starting with 747799b9b3a5e580ae4652f5d3f85171d7463e90e5cead513900e672ff724015 not found: ID does not exist"
Sep 16 14:40:34.648106 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.648068    2582 scope.go:117] "RemoveContainer" containerID="ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07"
Sep 16 14:40:34.648379 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:40:34.648361    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07\": container with ID starting with ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07 not found: ID does not exist" containerID="ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07"
Sep 16 14:40:34.648433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.648390    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07"} err="failed to get container status \"ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07\": rpc error: code = NotFound desc = could not find container \"ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07\": container with ID starting with ded8d119e5bd3c918a5e4a4e356c633729701bb4dd0678ccbdc6f91a80310d07 not found: ID does not exist"
Sep 16 14:40:34.665773 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.665751    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-token\") pod \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") "
Sep 16 14:40:34.665881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.665783    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkl2g\" (UniqueName: \"kubernetes.io/projected/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-kube-api-access-gkl2g\") pod \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") "
Sep 16 14:40:34.665881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.665817    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-workload-socket\") pod \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") "
Sep 16 14:40:34.666020 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.665997    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-workload-certs\") pod \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") "
Sep 16 14:40:34.666081 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666049    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-data\") pod \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") "
Sep 16 14:40:34.666081 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666066    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" (UID: "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:34.666186 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666092    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istiod-ca-cert\") pod \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") "
Sep 16 14:40:34.666186 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666115    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-credential-socket\") pod \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") "
Sep 16 14:40:34.666186 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666142    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-envoy\") pod \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") "
Sep 16 14:40:34.666186 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666170    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-podinfo\") pod \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\" (UID: \"b4e5d9ef-64d2-4a16-bde6-a48e40a0046e\") "
Sep 16 14:40:34.666435 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666258    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" (UID: "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:34.666435 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666380    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-data" (OuterVolumeSpecName: "istio-data") pod "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" (UID: "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:34.666435 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666400    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" (UID: "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:34.666602 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666463    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" (UID: "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:40:34.666659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666642    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-workload-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:34.666719 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666658    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-workload-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:34.666719 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666667    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-data\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:34.666719 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666675    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istiod-ca-cert\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:34.666719 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.666688    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-credential-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:34.668113 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.668088    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-token" (OuterVolumeSpecName: "istio-token") pod "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" (UID: "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:40:34.668113 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.668101    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-kube-api-access-gkl2g" (OuterVolumeSpecName: "kube-api-access-gkl2g") pod "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" (UID: "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e"). InnerVolumeSpecName "kube-api-access-gkl2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:40:34.668294 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.668227    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" (UID: "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:34.668294 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.668270    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" (UID: "b4e5d9ef-64d2-4a16-bde6-a48e40a0046e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:40:34.768054 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.768014    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-envoy\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:34.768054 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.768047    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-podinfo\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:34.768054 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.768055    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-istio-token\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:34.768517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.768066    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkl2g\" (UniqueName: \"kubernetes.io/projected/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e-kube-api-access-gkl2g\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:40:34.940858 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.940823    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"]
Sep 16 14:40:34.945114 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:34.945086    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj"]
Sep 16 14:40:35.180988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:35.180915    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" path="/var/lib/kubelet/pods/b4e5d9ef-64d2-4a16-bde6-a48e40a0046e/volumes"
Sep 16 14:40:35.794321 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:35.794287    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:36.469448 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:36.469413    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:36.564943 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:36.564915    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:36.664489 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:36.664457    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:37.503305 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:37.503270    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:38.223853 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:38.223821    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:39.016325 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:39.016293    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:39.682790 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:39.682755    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:40.678267 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:40.675977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:41.429758 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:41.429714    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:41.532082 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:41.532029    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:41.657891 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:41.657857    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:42.008392 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.008352    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:42.103010 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.102978    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:42.120419 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120390    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"]
Sep 16 14:40:42.120804 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120792    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy"
Sep 16 14:40:42.120845 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120805    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy"
Sep 16 14:40:42.120845 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120817    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5" containerName="maas-api"
Sep 16 14:40:42.120845 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120822    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5" containerName="maas-api"
Sep 16 14:40:42.120845 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120840    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebfe1b07-d3c9-4cc5-bc49-d97667cb3526" containerName="main"
Sep 16 14:40:42.120968 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120846    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebfe1b07-d3c9-4cc5-bc49-d97667cb3526" containerName="main"
Sep 16 14:40:42.120968 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120854    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy"
Sep 16 14:40:42.120968 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120859    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy"
Sep 16 14:40:42.120968 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120921    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebfe1b07-d3c9-4cc5-bc49-d97667cb3526" containerName="main"
Sep 16 14:40:42.120968 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120930    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy"
Sep 16 14:40:42.120968 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120938    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4e5d9ef-64d2-4a16-bde6-a48e40a0046e" containerName="istio-proxy"
Sep 16 14:40:42.120968 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.120945    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d04fb1fe-2ee5-4da8-a5f3-709a0644e6f5" containerName="maas-api"
Sep 16 14:40:42.125857 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.125837    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"
Sep 16 14:40:42.128428 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.128401    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-f891c2\""
Sep 16 14:40:42.128556 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.128401    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-f891c2-dockercfg-ndp85\""
Sep 16 14:40:42.135794 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.135772    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"]
Sep 16 14:40:42.145923 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.145900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d\" (UID: \"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"
Sep 16 14:40:42.146048 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.145943    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrtjh\" (UniqueName: \"kubernetes.io/projected/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7-kube-api-access-qrtjh\") pod \"payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d\" (UID: \"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"
Sep 16 14:40:42.247741 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.247690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d\" (UID: \"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"
Sep 16 14:40:42.247940 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.247776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrtjh\" (UniqueName: \"kubernetes.io/projected/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7-kube-api-access-qrtjh\") pod \"payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d\" (UID: \"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"
Sep 16 14:40:42.249204 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.249170    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d\" (UID: \"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"
Sep 16 14:40:42.260865 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.260749    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrtjh\" (UniqueName: \"kubernetes.io/projected/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7-kube-api-access-qrtjh\") pod \"payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d\" (UID: \"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"
Sep 16 14:40:42.437278 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.437217    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"
Sep 16 14:40:42.709940 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:42.709910    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"]
Sep 16 14:40:42.711041 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:40:42.711015    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a366cfa_3dcd_4bef_b5c2_4d6a055410c7.slice/crio-74d150812297be0c6963cb52f5a6d3e37b0910677e3e7caab24225c2d6e71c24 WatchSource:0}: Error finding container 74d150812297be0c6963cb52f5a6d3e37b0910677e3e7caab24225c2d6e71c24: Status 404 returned error can't find the container with id 74d150812297be0c6963cb52f5a6d3e37b0910677e3e7caab24225c2d6e71c24
Sep 16 14:40:43.412600 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:43.412546    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:43.516809 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:43.516765    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:43.672620 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:43.672537    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d" event={"ID":"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7","Type":"ContainerStarted","Data":"042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9"}
Sep 16 14:40:43.672620 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:43.672604    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d" event={"ID":"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7","Type":"ContainerStarted","Data":"74d150812297be0c6963cb52f5a6d3e37b0910677e3e7caab24225c2d6e71c24"}
Sep 16 14:40:43.672815 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:43.672741    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"
Sep 16 14:40:43.715454 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:43.715413    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d" podStartSLOduration=1.715397823 podStartE2EDuration="1.715397823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:40:43.712964351 +0000 UTC m=+1563.006652832" watchObservedRunningTime="2026-09-16 14:40:43.715397823 +0000 UTC m=+1563.009086351"
Sep 16 14:40:43.800514 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:43.800489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:49.612283 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:49.612248    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:54.680396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:54.680366    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"
Sep 16 14:40:56.044011 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:40:56.043976    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:01.125058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:01.125025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:02.472581 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:02.472543    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:04.612042 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:04.612003    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:05.445296 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:05.445255    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:06.185608 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:06.185577    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:06.625012 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:06.624979    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:41:06.636690 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:06.636656    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:07.116510 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:07.116472    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:08.026731 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:08.026698    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:08.899774 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:08.899742    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:09.687217 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:09.687184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:11.207261 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:11.207204    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:11.319518 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:11.319483    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:12.016983 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:12.016954    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:13.224816 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:13.224780    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:13.993693 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:13.993649    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:14.799440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:14.799404    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:15.641613 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:15.641586    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:16.347946 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:16.347916    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:19.918001 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:19.917970    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:24.060282 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:24.060228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:25.389460 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.389428    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:25.489365 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.489334    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:25.664678 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.664602    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:25.687272 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.687219    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"]
Sep 16 14:41:25.687678 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.687452    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw" podUID="72b2f75e-f06b-453a-a4d8-61528a5d4934" containerName="payload-processing" containerID="cri-o://fdcb58b958eea5f0778c490abd1ea978e00f5d37490bc51893ab3d1695005762" gracePeriod=30
Sep 16 14:41:25.693671 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.693634    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"]
Sep 16 14:41:25.693887 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.693861    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942" podUID="4b1f8250-0d2c-4a51-b9c3-7fd5120b4419" containerName="payload-pre-processing" containerID="cri-o://77ce3a10240da93408e79a3de40f4f9421cd7f0fc463c3291252bc3295a06a69" gracePeriod=30
Sep 16 14:41:25.731827 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.731793    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:25.796749 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.796711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:25.904421 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.904393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:25.933326 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.931897    2582 generic.go:356] "Generic (PLEG): container finished" podID="72b2f75e-f06b-453a-a4d8-61528a5d4934" containerID="fdcb58b958eea5f0778c490abd1ea978e00f5d37490bc51893ab3d1695005762" exitCode=0
Sep 16 14:41:25.933326 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.932117    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw" event={"ID":"72b2f75e-f06b-453a-a4d8-61528a5d4934","Type":"ContainerDied","Data":"fdcb58b958eea5f0778c490abd1ea978e00f5d37490bc51893ab3d1695005762"}
Sep 16 14:41:25.943552 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.941608    2582 generic.go:356] "Generic (PLEG): container finished" podID="4b1f8250-0d2c-4a51-b9c3-7fd5120b4419" containerID="77ce3a10240da93408e79a3de40f4f9421cd7f0fc463c3291252bc3295a06a69" exitCode=0
Sep 16 14:41:25.943552 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.941673    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942" event={"ID":"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419","Type":"ContainerDied","Data":"77ce3a10240da93408e79a3de40f4f9421cd7f0fc463c3291252bc3295a06a69"}
Sep 16 14:41:25.987350 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.987329    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"
Sep 16 14:41:25.991511 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:25.991494    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"
Sep 16 14:41:26.062662 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.062632    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419-plugins-config-volume\") pod \"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419\" (UID: \"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419\") "
Sep 16 14:41:26.062832 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.062762    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-549wt\" (UniqueName: \"kubernetes.io/projected/72b2f75e-f06b-453a-a4d8-61528a5d4934-kube-api-access-549wt\") pod \"72b2f75e-f06b-453a-a4d8-61528a5d4934\" (UID: \"72b2f75e-f06b-453a-a4d8-61528a5d4934\") "
Sep 16 14:41:26.062832 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.062797    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b2f75e-f06b-453a-a4d8-61528a5d4934-plugins-config-volume\") pod \"72b2f75e-f06b-453a-a4d8-61528a5d4934\" (UID: \"72b2f75e-f06b-453a-a4d8-61528a5d4934\") "
Sep 16 14:41:26.062929 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.062841    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs66m\" (UniqueName: \"kubernetes.io/projected/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419-kube-api-access-cs66m\") pod \"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419\" (UID: \"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419\") "
Sep 16 14:41:26.063178 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.063151    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b1f8250-0d2c-4a51-b9c3-7fd5120b4419" (UID: "4b1f8250-0d2c-4a51-b9c3-7fd5120b4419"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:41:26.063311 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.063178    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72b2f75e-f06b-453a-a4d8-61528a5d4934-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "72b2f75e-f06b-453a-a4d8-61528a5d4934" (UID: "72b2f75e-f06b-453a-a4d8-61528a5d4934"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:41:26.063311 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.063217    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419-plugins-config-volume\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:26.064893 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.064864    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72b2f75e-f06b-453a-a4d8-61528a5d4934-kube-api-access-549wt" (OuterVolumeSpecName: "kube-api-access-549wt") pod "72b2f75e-f06b-453a-a4d8-61528a5d4934" (UID: "72b2f75e-f06b-453a-a4d8-61528a5d4934"). InnerVolumeSpecName "kube-api-access-549wt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:41:26.064979 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.064951    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419-kube-api-access-cs66m" (OuterVolumeSpecName: "kube-api-access-cs66m") pod "4b1f8250-0d2c-4a51-b9c3-7fd5120b4419" (UID: "4b1f8250-0d2c-4a51-b9c3-7fd5120b4419"). InnerVolumeSpecName "kube-api-access-cs66m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:41:26.164200 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.164169    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-549wt\" (UniqueName: \"kubernetes.io/projected/72b2f75e-f06b-453a-a4d8-61528a5d4934-kube-api-access-549wt\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:26.164200 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.164197    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72b2f75e-f06b-453a-a4d8-61528a5d4934-plugins-config-volume\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:26.164382 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.164206    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs66m\" (UniqueName: \"kubernetes.io/projected/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419-kube-api-access-cs66m\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:26.226605 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.226530    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:26.328448 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.328407    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:26.949537 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.949504    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"
Sep 16 14:41:26.949537 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.949513    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942" event={"ID":"4b1f8250-0d2c-4a51-b9c3-7fd5120b4419","Type":"ContainerDied","Data":"b572378c36f7638cc6be89e01b9ab726438af4a2f23cba2df602341d2d540d67"}
Sep 16 14:41:26.950062 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.949570    2582 scope.go:117] "RemoveContainer" containerID="77ce3a10240da93408e79a3de40f4f9421cd7f0fc463c3291252bc3295a06a69"
Sep 16 14:41:26.950988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.950966    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"
Sep 16 14:41:26.951111 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.951021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw" event={"ID":"72b2f75e-f06b-453a-a4d8-61528a5d4934","Type":"ContainerDied","Data":"a881f4c2a45b1eeda229e7317f92d141ec9e556d557c656a0f358d10d1eb9c71"}
Sep 16 14:41:26.961760 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.961737    2582 scope.go:117] "RemoveContainer" containerID="fdcb58b958eea5f0778c490abd1ea978e00f5d37490bc51893ab3d1695005762"
Sep 16 14:41:26.979936 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.979903    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"]
Sep 16 14:41:26.983635 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.983611    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942"]
Sep 16 14:41:26.994218 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.994194    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"]
Sep 16 14:41:26.998395 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:26.998372    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw"]
Sep 16 14:41:27.016978 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:27.016955    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:27.180574 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:27.180539    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b1f8250-0d2c-4a51-b9c3-7fd5120b4419" path="/var/lib/kubelet/pods/4b1f8250-0d2c-4a51-b9c3-7fd5120b4419/volumes"
Sep 16 14:41:27.180909 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:27.180896    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72b2f75e-f06b-453a-a4d8-61528a5d4934" path="/var/lib/kubelet/pods/72b2f75e-f06b-453a-a4d8-61528a5d4934/volumes"
Sep 16 14:41:27.757249 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:27.757183    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:28.558340 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:28.558302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:29.338513 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:29.338482    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:30.153163 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:30.153126    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:30.985518 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:30.985484    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:31.422907 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:31.422874    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:41:32.526304 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:32.526265    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:33.115167 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:33.115132    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:33.209538 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:33.209510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:33.407551 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:33.407473    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:34.045993 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:34.045964    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:35.169712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:35.169678    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:35.888764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:35.888730    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:36.815965 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:36.815938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:37.557252 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:37.557206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:37.656488 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:37.656453    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:38.738882 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:38.738851    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:39.627561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:39.627522    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:40.535577 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:40.535547    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:40.640174 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:40.640130    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:41.750937 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:41.750849    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:42.712468 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:42.712439    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"]
Sep 16 14:41:42.908117 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:42.908089    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:43.036801 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:43.036776    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:44.215414 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:44.215375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:45.179104 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:45.179068    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:46.451036 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:46.451005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:52.641579 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:52.641542    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:52.679799 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:52.679767    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"]
Sep 16 14:41:52.680028 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:52.680003    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d" podUID="2a366cfa-3dcd-4bef-b5c2-4d6a055410c7" containerName="payload-pre-processing" containerID="cri-o://042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9" gracePeriod=30
Sep 16 14:41:52.743572 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:52.743544    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:52.848303 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:52.848199    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:52.938375 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:52.938318    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"
Sep 16 14:41:52.938798 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:52.938777    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:53.106288 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.106216    2582 generic.go:356] "Generic (PLEG): container finished" podID="2a366cfa-3dcd-4bef-b5c2-4d6a055410c7" containerID="042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9" exitCode=0
Sep 16 14:41:53.106288 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.106288    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"
Sep 16 14:41:53.106557 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.106305    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d" event={"ID":"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7","Type":"ContainerDied","Data":"042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9"}
Sep 16 14:41:53.106557 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.106374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d" event={"ID":"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7","Type":"ContainerDied","Data":"74d150812297be0c6963cb52f5a6d3e37b0910677e3e7caab24225c2d6e71c24"}
Sep 16 14:41:53.106557 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.106406    2582 scope.go:117] "RemoveContainer" containerID="042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9"
Sep 16 14:41:53.116680 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.116650    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7-plugins-config-volume\") pod \"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7\" (UID: \"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7\") "
Sep 16 14:41:53.116780 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.116731    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrtjh\" (UniqueName: \"kubernetes.io/projected/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7-kube-api-access-qrtjh\") pod \"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7\" (UID: \"2a366cfa-3dcd-4bef-b5c2-4d6a055410c7\") "
Sep 16 14:41:53.117070 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.117046    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2a366cfa-3dcd-4bef-b5c2-4d6a055410c7" (UID: "2a366cfa-3dcd-4bef-b5c2-4d6a055410c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:41:53.117317 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.117291    2582 scope.go:117] "RemoveContainer" containerID="042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9"
Sep 16 14:41:53.117616 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:41:53.117598    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9\": container with ID starting with 042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9 not found: ID does not exist" containerID="042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9"
Sep 16 14:41:53.117666 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.117625    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9"} err="failed to get container status \"042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9\": rpc error: code = NotFound desc = could not find container \"042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9\": container with ID starting with 042bd59d433a104bc6414d126e4760b92e349eac93fd752e608285bf1a7beba9 not found: ID does not exist"
Sep 16 14:41:53.118727 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.118709    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7-kube-api-access-qrtjh" (OuterVolumeSpecName: "kube-api-access-qrtjh") pod "2a366cfa-3dcd-4bef-b5c2-4d6a055410c7" (UID: "2a366cfa-3dcd-4bef-b5c2-4d6a055410c7"). InnerVolumeSpecName "kube-api-access-qrtjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:41:53.138090 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.138068    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:53.218452 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.218415    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7-plugins-config-volume\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:53.218452 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.218445    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrtjh\" (UniqueName: \"kubernetes.io/projected/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7-kube-api-access-qrtjh\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:53.284538 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.284510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:53.422755 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.422718    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"]
Sep 16 14:41:53.428947 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:53.428924    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d"]
Sep 16 14:41:54.203432 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:54.203399    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:54.959675 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:54.959641    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:55.179929 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:55.179896    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a366cfa-3dcd-4bef-b5c2-4d6a055410c7" path="/var/lib/kubelet/pods/2a366cfa-3dcd-4bef-b5c2-4d6a055410c7/volumes"
Sep 16 14:41:55.642114 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:55.642082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:56.204215 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:56.204182    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"]
Sep 16 14:41:56.239557 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:56.239522    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:56.315979 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:56.315946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:56.346063 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:41:56.346027    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-serving-cert: secret "maas-api-e2e-worker-w4-5d484d-serving-cert" not found
Sep 16 14:41:56.346221 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:41:56.346104    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-maas-api-tls podName:f1e4cdf7-f50c-4b2f-b450-58dcd08bf651 nodeName:}" failed. No retries permitted until 2026-09-16 14:41:56.846084809 +0000 UTC m=+1636.139773280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-maas-api-tls") pod "maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk" (UID: "f1e4cdf7-f50c-4b2f-b450-58dcd08bf651") : secret "maas-api-e2e-worker-w4-5d484d-serving-cert" not found
Sep 16 14:41:56.384204 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:56.384175    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:56.454023 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:56.453999    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:56.521645 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:56.521577    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:56.811871 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:56.811842    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:56.851067 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:41:56.851037    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-serving-cert: secret "maas-api-e2e-worker-w4-5d484d-serving-cert" not found
Sep 16 14:41:56.851200 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:41:56.851095    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-maas-api-tls podName:f1e4cdf7-f50c-4b2f-b450-58dcd08bf651 nodeName:}" failed. No retries permitted until 2026-09-16 14:41:57.8510827 +0000 UTC m=+1637.144771162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-maas-api-tls") pod "maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk" (UID: "f1e4cdf7-f50c-4b2f-b450-58dcd08bf651") : secret "maas-api-e2e-worker-w4-5d484d-serving-cert" not found
Sep 16 14:41:57.132393 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.132306    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk" podUID="f1e4cdf7-f50c-4b2f-b450-58dcd08bf651" containerName="maas-api" containerID="cri-o://213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8" gracePeriod=30
Sep 16 14:41:57.209922 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.209894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:57.392847 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.392789    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:41:57.556686 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.556656    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-openshift-service-ca\") pod \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") "
Sep 16 14:41:57.556873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.556722    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-maas-api-tls\") pod \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") "
Sep 16 14:41:57.556873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.556788    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wqs6\" (UniqueName: \"kubernetes.io/projected/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-kube-api-access-7wqs6\") pod \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") "
Sep 16 14:41:57.556873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.556812    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-metrics-certs\") pod \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\" (UID: \"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651\") "
Sep 16 14:41:57.557053 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.557029    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f1e4cdf7-f50c-4b2f-b450-58dcd08bf651" (UID: "f1e4cdf7-f50c-4b2f-b450-58dcd08bf651"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:41:57.557171 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.557137    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:57.558968 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.558935    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f1e4cdf7-f50c-4b2f-b450-58dcd08bf651" (UID: "f1e4cdf7-f50c-4b2f-b450-58dcd08bf651"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:41:57.559052 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.559019    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f1e4cdf7-f50c-4b2f-b450-58dcd08bf651" (UID: "f1e4cdf7-f50c-4b2f-b450-58dcd08bf651"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:41:57.559052 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.559019    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-kube-api-access-7wqs6" (OuterVolumeSpecName: "kube-api-access-7wqs6") pod "f1e4cdf7-f50c-4b2f-b450-58dcd08bf651" (UID: "f1e4cdf7-f50c-4b2f-b450-58dcd08bf651"). InnerVolumeSpecName "kube-api-access-7wqs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:41:57.658459 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.658401    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:57.658459 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.658422    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wqs6\" (UniqueName: \"kubernetes.io/projected/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-kube-api-access-7wqs6\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:57.658459 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.658431    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:57.731519 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.731481    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv" podUID="35a2abc4-3289-419b-94ef-698b10d96441" containerName="main" containerID="cri-o://c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177" gracePeriod=45
Sep 16 14:41:57.931469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.931396    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:57.975612 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:57.975577    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:41:58.061545 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.061513    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl8h6\" (UniqueName: \"kubernetes.io/projected/35a2abc4-3289-419b-94ef-698b10d96441-kube-api-access-bl8h6\") pod \"35a2abc4-3289-419b-94ef-698b10d96441\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") "
Sep 16 14:41:58.061721 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.061583    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-model-cache\") pod \"35a2abc4-3289-419b-94ef-698b10d96441\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") "
Sep 16 14:41:58.061721 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.061634    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35a2abc4-3289-419b-94ef-698b10d96441-tls-certs\") pod \"35a2abc4-3289-419b-94ef-698b10d96441\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") "
Sep 16 14:41:58.061721 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.061664    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-home\") pod \"35a2abc4-3289-419b-94ef-698b10d96441\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") "
Sep 16 14:41:58.061903 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.061726    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-dshm\") pod \"35a2abc4-3289-419b-94ef-698b10d96441\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") "
Sep 16 14:41:58.061903 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.061754    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-tmp-dir\") pod \"35a2abc4-3289-419b-94ef-698b10d96441\" (UID: \"35a2abc4-3289-419b-94ef-698b10d96441\") "
Sep 16 14:41:58.062021 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.061918    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-model-cache" (OuterVolumeSpecName: "model-cache") pod "35a2abc4-3289-419b-94ef-698b10d96441" (UID: "35a2abc4-3289-419b-94ef-698b10d96441"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:41:58.062123 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.062102    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-model-cache\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:58.062293 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.062215    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "35a2abc4-3289-419b-94ef-698b10d96441" (UID: "35a2abc4-3289-419b-94ef-698b10d96441"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:41:58.062385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.062280    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-home" (OuterVolumeSpecName: "home") pod "35a2abc4-3289-419b-94ef-698b10d96441" (UID: "35a2abc4-3289-419b-94ef-698b10d96441"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:41:58.063891 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.063862    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35a2abc4-3289-419b-94ef-698b10d96441-kube-api-access-bl8h6" (OuterVolumeSpecName: "kube-api-access-bl8h6") pod "35a2abc4-3289-419b-94ef-698b10d96441" (UID: "35a2abc4-3289-419b-94ef-698b10d96441"). InnerVolumeSpecName "kube-api-access-bl8h6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:41:58.064419 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.064394    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-dshm" (OuterVolumeSpecName: "dshm") pod "35a2abc4-3289-419b-94ef-698b10d96441" (UID: "35a2abc4-3289-419b-94ef-698b10d96441"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:41:58.064419 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.064397    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35a2abc4-3289-419b-94ef-698b10d96441-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "35a2abc4-3289-419b-94ef-698b10d96441" (UID: "35a2abc4-3289-419b-94ef-698b10d96441"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:41:58.139169 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.139141    2582 generic.go:356] "Generic (PLEG): container finished" podID="f1e4cdf7-f50c-4b2f-b450-58dcd08bf651" containerID="213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8" exitCode=0
Sep 16 14:41:58.139339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.139187    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"
Sep 16 14:41:58.139339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.139227    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk" event={"ID":"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651","Type":"ContainerDied","Data":"213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8"}
Sep 16 14:41:58.139339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.139294    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk" event={"ID":"f1e4cdf7-f50c-4b2f-b450-58dcd08bf651","Type":"ContainerDied","Data":"aceb9c7c6ea389c190261ecf420c1f0005d31fd24c14f071d89363ef6b2f2f45"}
Sep 16 14:41:58.139339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.139318    2582 scope.go:117] "RemoveContainer" containerID="213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8"
Sep 16 14:41:58.140780 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.140758    2582 generic.go:356] "Generic (PLEG): container finished" podID="35a2abc4-3289-419b-94ef-698b10d96441" containerID="c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177" exitCode=0
Sep 16 14:41:58.140887 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.140805    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"
Sep 16 14:41:58.140956 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.140806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv" event={"ID":"35a2abc4-3289-419b-94ef-698b10d96441","Type":"ContainerDied","Data":"c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177"}
Sep 16 14:41:58.140956 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.140928    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv" event={"ID":"35a2abc4-3289-419b-94ef-698b10d96441","Type":"ContainerDied","Data":"43b0f0c180e73b6892491ec920e71694edab0b3290a442a1d5143408af0ac679"}
Sep 16 14:41:58.150508 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.150494    2582 scope.go:117] "RemoveContainer" containerID="213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8"
Sep 16 14:41:58.150768 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:41:58.150745    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8\": container with ID starting with 213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8 not found: ID does not exist" containerID="213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8"
Sep 16 14:41:58.150809 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.150782    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8"} err="failed to get container status \"213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8\": rpc error: code = NotFound desc = could not find container \"213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8\": container with ID starting with 213cf7dccaa3391c53b3995f59b1f88856afe9a8674fdcaba6c88eb89537d3f8 not found: ID does not exist"
Sep 16 14:41:58.150809 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.150806    2582 scope.go:117] "RemoveContainer" containerID="c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177"
Sep 16 14:41:58.163172 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.163050    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35a2abc4-3289-419b-94ef-698b10d96441-tls-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:58.163172 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.163072    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-home\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:58.163172 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.163080    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-dshm\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:58.163172 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.163087    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35a2abc4-3289-419b-94ef-698b10d96441-tmp-dir\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:58.163172 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.163097    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl8h6\" (UniqueName: \"kubernetes.io/projected/35a2abc4-3289-419b-94ef-698b10d96441-kube-api-access-bl8h6\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:41:58.163402 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.163176    2582 scope.go:117] "RemoveContainer" containerID="c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177"
Sep 16 14:41:58.163444 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:41:58.163434    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177\": container with ID starting with c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177 not found: ID does not exist" containerID="c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177"
Sep 16 14:41:58.163483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.163453    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177"} err="failed to get container status \"c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177\": rpc error: code = NotFound desc = could not find container \"c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177\": container with ID starting with c68183a3674e0c63c12508727fc7492979c5a50791454a3048664a631154d177 not found: ID does not exist"
Sep 16 14:41:58.176078 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.176055    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"]
Sep 16 14:41:58.180080 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.180060    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5d484d/distinct-w4-5d484d-kserve-6897c7f77d-mbghv"]
Sep 16 14:41:58.193688 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.193639    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"]
Sep 16 14:41:58.197417 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.197398    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5d484d-664b95d577-wx5sk"]
Sep 16 14:41:58.707247 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.707212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:58.922560 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:58.922509    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:41:59.180190 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:59.180158    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35a2abc4-3289-419b-94ef-698b10d96441" path="/var/lib/kubelet/pods/35a2abc4-3289-419b-94ef-698b10d96441/volumes"
Sep 16 14:41:59.180736 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:59.180714    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1e4cdf7-f50c-4b2f-b450-58dcd08bf651" path="/var/lib/kubelet/pods/f1e4cdf7-f50c-4b2f-b450-58dcd08bf651/volumes"
Sep 16 14:41:59.518154 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:59.518067    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:59.913066 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:41:59.913028    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:00.020261 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:00.020210    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:00.113032 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:00.112994    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:00.344620 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:00.344587    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:00.440280 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:00.440250    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:01.420779 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:01.420743    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:02.229418 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:02.229388    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:02.992422 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:02.992388    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:03.292598 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:03.292562    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:03.393195 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:03.393163    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:03.544454 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:03.544367    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"]
Sep 16 14:42:03.544653 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:03.544627    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy" containerID="cri-o://ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184" gracePeriod=30
Sep 16 14:42:03.580385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:03.580356    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:03.729186 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:03.729157    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:04.588075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:04.588043    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:08.804064 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.804039    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:42:08.862089 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862012    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-workload-certs\") pod \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") "
Sep 16 14:42:08.862089 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862083    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-data\") pod \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") "
Sep 16 14:42:08.862315 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862113    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6gmp\" (UniqueName: \"kubernetes.io/projected/c40e824f-371d-4ffd-9a4a-bc456034ae9f-kube-api-access-c6gmp\") pod \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") "
Sep 16 14:42:08.862315 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862148    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istiod-ca-cert\") pod \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") "
Sep 16 14:42:08.862315 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862204    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-podinfo\") pod \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") "
Sep 16 14:42:08.862315 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862230    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-workload-socket\") pod \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") "
Sep 16 14:42:08.862315 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862297    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-token\") pod \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") "
Sep 16 14:42:08.862582 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862305    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c40e824f-371d-4ffd-9a4a-bc456034ae9f" (UID: "c40e824f-371d-4ffd-9a4a-bc456034ae9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:08.862582 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862371    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c40e824f-371d-4ffd-9a4a-bc456034ae9f" (UID: "c40e824f-371d-4ffd-9a4a-bc456034ae9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:08.862693 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862587    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c40e824f-371d-4ffd-9a4a-bc456034ae9f" (UID: "c40e824f-371d-4ffd-9a4a-bc456034ae9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:08.862693 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862647    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-credential-socket\") pod \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") "
Sep 16 14:42:08.862693 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862675    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c40e824f-371d-4ffd-9a4a-bc456034ae9f" (UID: "c40e824f-371d-4ffd-9a4a-bc456034ae9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:08.862693 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862690    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-envoy\") pod \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\" (UID: \"c40e824f-371d-4ffd-9a4a-bc456034ae9f\") "
Sep 16 14:42:08.862886 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.862687    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c40e824f-371d-4ffd-9a4a-bc456034ae9f" (UID: "c40e824f-371d-4ffd-9a4a-bc456034ae9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:42:08.863069 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.863035    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-data\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.863069 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.863056    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istiod-ca-cert\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.863069 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.863068    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-workload-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.863343 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.863080    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-credential-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.863343 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.863088    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-workload-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.864497 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.864469    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c40e824f-371d-4ffd-9a4a-bc456034ae9f" (UID: "c40e824f-371d-4ffd-9a4a-bc456034ae9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:42:08.864835 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.864801    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c40e824f-371d-4ffd-9a4a-bc456034ae9f" (UID: "c40e824f-371d-4ffd-9a4a-bc456034ae9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:42:08.864835 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.864824    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c40e824f-371d-4ffd-9a4a-bc456034ae9f-kube-api-access-c6gmp" (OuterVolumeSpecName: "kube-api-access-c6gmp") pod "c40e824f-371d-4ffd-9a4a-bc456034ae9f" (UID: "c40e824f-371d-4ffd-9a4a-bc456034ae9f"). InnerVolumeSpecName "kube-api-access-c6gmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:42:08.864945 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.864856    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c40e824f-371d-4ffd-9a4a-bc456034ae9f" (UID: "c40e824f-371d-4ffd-9a4a-bc456034ae9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:08.963663 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.963631    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6gmp\" (UniqueName: \"kubernetes.io/projected/c40e824f-371d-4ffd-9a4a-bc456034ae9f-kube-api-access-c6gmp\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.963663 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.963657    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-podinfo\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.963663 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.963667    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-token\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.963867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:08.963675    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c40e824f-371d-4ffd-9a4a-bc456034ae9f-istio-envoy\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:09.202845 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:09.202811    2582 generic.go:356] "Generic (PLEG): container finished" podID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerID="ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184" exitCode=0
Sep 16 14:42:09.202976 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:09.202858    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"
Sep 16 14:42:09.202976 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:09.202858    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" event={"ID":"c40e824f-371d-4ffd-9a4a-bc456034ae9f","Type":"ContainerDied","Data":"ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184"}
Sep 16 14:42:09.203051 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:09.202975    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4" event={"ID":"c40e824f-371d-4ffd-9a4a-bc456034ae9f","Type":"ContainerDied","Data":"0904e8c39d2c909622280b400a4201c049996ffdb474805bb8c82d5b29aeb464"}
Sep 16 14:42:09.203051 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:09.203008    2582 scope.go:117] "RemoveContainer" containerID="ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184"
Sep 16 14:42:09.212798 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:09.212780    2582 scope.go:117] "RemoveContainer" containerID="06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f"
Sep 16 14:42:09.220981 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:09.220956    2582 scope.go:117] "RemoveContainer" containerID="ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184"
Sep 16 14:42:09.221330 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:42:09.221221    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184\": container with ID starting with ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184 not found: ID does not exist" containerID="ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184"
Sep 16 14:42:09.221405 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:09.221338    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184"} err="failed to get container status \"ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184\": rpc error: code = NotFound desc = could not find container \"ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184\": container with ID starting with ddfb9d764561bdd390e80f6751dda31193ed66be4dbf227243f9a6c6862e3184 not found: ID does not exist"
Sep 16 14:42:09.221405 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:09.221359    2582 scope.go:117] "RemoveContainer" containerID="06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f"
Sep 16 14:42:09.221628 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:42:09.221611    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f\": container with ID starting with 06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f not found: ID does not exist" containerID="06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f"
Sep 16 14:42:09.221670 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:09.221636    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f"} err="failed to get container status \"06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f\": rpc error: code = NotFound desc = could not find container \"06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f\": container with ID starting with 06bc2ca9c311db4abcf7583611a45926803ad4cb753e471c26f0912f6b54062f not found: ID does not exist"
Sep 16 14:42:09.226731 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:09.226698    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"]
Sep 16 14:42:09.229010 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:09.228986    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4"]
Sep 16 14:42:11.142753 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.142721    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"]
Sep 16 14:42:11.143126 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.142922    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x" podUID="82c190e2-3382-40d2-a559-0bf0fb89b6d9" containerName="maas-api" containerID="cri-o://af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626" gracePeriod=30
Sep 16 14:42:11.167135 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.167104    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:11.181551 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.181524    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" path="/var/lib/kubelet/pods/c40e824f-371d-4ffd-9a4a-bc456034ae9f/volumes"
Sep 16 14:42:11.240676 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.240641    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:11.328730 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.328702    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:11.389257 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.389220    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:42:11.416766 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.416695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:11.487879 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.487849    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-metrics-certs\") pod \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") "
Sep 16 14:42:11.488021 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.487929    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-maas-api-tls\") pod \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") "
Sep 16 14:42:11.488077 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.488024    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpkbf\" (UniqueName: \"kubernetes.io/projected/82c190e2-3382-40d2-a559-0bf0fb89b6d9-kube-api-access-lpkbf\") pod \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") "
Sep 16 14:42:11.488077 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.488054    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c190e2-3382-40d2-a559-0bf0fb89b6d9-openshift-service-ca\") pod \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\" (UID: \"82c190e2-3382-40d2-a559-0bf0fb89b6d9\") "
Sep 16 14:42:11.488544 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.488514    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82c190e2-3382-40d2-a559-0bf0fb89b6d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "82c190e2-3382-40d2-a559-0bf0fb89b6d9" (UID: "82c190e2-3382-40d2-a559-0bf0fb89b6d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:42:11.490128 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.490099    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "82c190e2-3382-40d2-a559-0bf0fb89b6d9" (UID: "82c190e2-3382-40d2-a559-0bf0fb89b6d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:42:11.490128 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.490114    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "82c190e2-3382-40d2-a559-0bf0fb89b6d9" (UID: "82c190e2-3382-40d2-a559-0bf0fb89b6d9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:42:11.490272 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.490138    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c190e2-3382-40d2-a559-0bf0fb89b6d9-kube-api-access-lpkbf" (OuterVolumeSpecName: "kube-api-access-lpkbf") pod "82c190e2-3382-40d2-a559-0bf0fb89b6d9" (UID: "82c190e2-3382-40d2-a559-0bf0fb89b6d9"). InnerVolumeSpecName "kube-api-access-lpkbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:42:11.589155 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.589119    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpkbf\" (UniqueName: \"kubernetes.io/projected/82c190e2-3382-40d2-a559-0bf0fb89b6d9-kube-api-access-lpkbf\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:11.589155 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.589149    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c190e2-3382-40d2-a559-0bf0fb89b6d9-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:11.589155 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.589161    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:11.589422 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.589169    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c190e2-3382-40d2-a559-0bf0fb89b6d9-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:11.765867 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.765784    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:11.886570 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:11.886536    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:12.228852 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:12.228817    2582 generic.go:356] "Generic (PLEG): container finished" podID="82c190e2-3382-40d2-a559-0bf0fb89b6d9" containerID="af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626" exitCode=0
Sep 16 14:42:12.228852 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:12.228854    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x" event={"ID":"82c190e2-3382-40d2-a559-0bf0fb89b6d9","Type":"ContainerDied","Data":"af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626"}
Sep 16 14:42:12.229415 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:12.228874    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"
Sep 16 14:42:12.229415 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:12.228896    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x" event={"ID":"82c190e2-3382-40d2-a559-0bf0fb89b6d9","Type":"ContainerDied","Data":"91a169e94a2433569273319ffade9e95e6c01b17fff767e5b4521dc359019639"}
Sep 16 14:42:12.229415 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:12.228918    2582 scope.go:117] "RemoveContainer" containerID="af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626"
Sep 16 14:42:12.238524 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:12.238505    2582 scope.go:117] "RemoveContainer" containerID="af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626"
Sep 16 14:42:12.238799 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:42:12.238771    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626\": container with ID starting with af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626 not found: ID does not exist" containerID="af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626"
Sep 16 14:42:12.238860 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:12.238804    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626"} err="failed to get container status \"af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626\": rpc error: code = NotFound desc = could not find container \"af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626\": container with ID starting with af3252d5ea1ae29232f0efc9556f276c8a755f38c8dc98c5e9c3fba526f41626 not found: ID does not exist"
Sep 16 14:42:12.251639 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:12.251612    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"]
Sep 16 14:42:12.255092 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:12.255071    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4c2787-78557964b6-slv7x"]
Sep 16 14:42:12.658814 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:12.658774    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:13.180596 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:13.180561    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82c190e2-3382-40d2-a559-0bf0fb89b6d9" path="/var/lib/kubelet/pods/82c190e2-3382-40d2-a559-0bf0fb89b6d9/volumes"
Sep 16 14:42:13.393443 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:13.393403    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:14.037517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:14.037479    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:17.720367 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:17.720323    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:17.819304 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:17.819270    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:18.060923 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:18.060894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:18.684460 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:18.684422    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:19.593530 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:19.593492    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:19.713385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:19.713344    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:42:19.866091 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:19.866002    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"]
Sep 16 14:42:19.895730 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:19.895697    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:20.330323 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:20.330286    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:20.440208 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:20.440179    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:20.539404 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:20.539371    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:21.004734 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:21.004697    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:21.618472 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:21.618436    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:21.885963 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:21.885881    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:23.621544 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:23.621511    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:27.280110 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:27.280074    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:28.863545 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:28.863509    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:28.968974 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:28.968947    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:29.046696 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:29.046660    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:29.178495 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:29.178411    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:29.343613 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:29.343570    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:30.023689 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:30.023652    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:30.223688 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:30.223655    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:30.777986 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:30.777946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:32.814212 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:32.814174    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:42:34.416652 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:34.416619    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:34.885222 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:34.885184    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6" podUID="9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9" containerName="main" containerID="cri-o://67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb" gracePeriod=45
Sep 16 14:42:35.143941 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.143871    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:35.149444 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.149422    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:42:35.311856 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.311821    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-tls-certs\") pod \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") "
Sep 16 14:42:35.312040 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.311913    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-tmp-dir\") pod \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") "
Sep 16 14:42:35.312040 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.311934    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-dshm\") pod \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") "
Sep 16 14:42:35.312040 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.312005    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-home\") pod \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") "
Sep 16 14:42:35.312040 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.312023    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5h4r\" (UniqueName: \"kubernetes.io/projected/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-kube-api-access-r5h4r\") pod \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") "
Sep 16 14:42:35.312222 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.312043    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-model-cache\") pod \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\" (UID: \"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9\") "
Sep 16 14:42:35.312314 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.312210    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9" (UID: "9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:35.312375 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.312309    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-home" (OuterVolumeSpecName: "home") pod "9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9" (UID: "9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:35.312431 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.312415    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-tmp-dir\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:35.312487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.312433    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-home\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:35.312487 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.312446    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-model-cache" (OuterVolumeSpecName: "model-cache") pod "9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9" (UID: "9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:35.314349 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.314315    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-dshm" (OuterVolumeSpecName: "dshm") pod "9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9" (UID: "9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:35.314460 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.314326    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9" (UID: "9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:42:35.314460 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.314400    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-kube-api-access-r5h4r" (OuterVolumeSpecName: "kube-api-access-r5h4r") pod "9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9" (UID: "9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9"). InnerVolumeSpecName "kube-api-access-r5h4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:42:35.360707 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.360671    2582 generic.go:356] "Generic (PLEG): container finished" podID="9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9" containerID="67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb" exitCode=0
Sep 16 14:42:35.360898 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.360712    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"
Sep 16 14:42:35.360898 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.360716    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6" event={"ID":"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9","Type":"ContainerDied","Data":"67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb"}
Sep 16 14:42:35.360898 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.360756    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6" event={"ID":"9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9","Type":"ContainerDied","Data":"d110b9104c42ad7f586403bcf0631e076f1e6aaedb3b01f9d9fea15bb3ef3d00"}
Sep 16 14:42:35.360898 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.360777    2582 scope.go:117] "RemoveContainer" containerID="67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb"
Sep 16 14:42:35.371525 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.371324    2582 scope.go:117] "RemoveContainer" containerID="67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb"
Sep 16 14:42:35.373301 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:42:35.373280    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb\": container with ID starting with 67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb not found: ID does not exist" containerID="67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb"
Sep 16 14:42:35.373395 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.373310    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb"} err="failed to get container status \"67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb\": rpc error: code = NotFound desc = could not find container \"67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb\": container with ID starting with 67a13c25172d420f92acf1408ba832eebb6347f38cfd2681ef7d5a2e9e877dcb not found: ID does not exist"
Sep 16 14:42:35.384933 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.384910    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"]
Sep 16 14:42:35.390404 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.390383    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-9f88e1/auth-test-model-9f88e1-kserve-6c44fc5fff-sbdl6"]
Sep 16 14:42:35.412999 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.412931    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5h4r\" (UniqueName: \"kubernetes.io/projected/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-kube-api-access-r5h4r\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:35.412999 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.412961    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-model-cache\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:35.412999 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.412974    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-tls-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:35.412999 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:35.412985    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9-dshm\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:37.180274 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:37.180228    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9" path="/var/lib/kubelet/pods/9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9/volumes"
Sep 16 14:42:40.359266 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:40.359213    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:40.420800 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:40.420765    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:44.521017 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:44.520981    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:42:45.636254 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:45.635931    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"]
Sep 16 14:42:45.640460 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:45.636779    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerName="istio-proxy" containerID="cri-o://d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8" gracePeriod=30
Sep 16 14:42:45.649653 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:45.649629    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:50.892405 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.892382    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:42:50.947058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.946997    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-workload-socket\") pod \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") "
Sep 16 14:42:50.947058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947036    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-token\") pod \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") "
Sep 16 14:42:50.947260 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947067    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrbqd\" (UniqueName: \"kubernetes.io/projected/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-kube-api-access-mrbqd\") pod \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") "
Sep 16 14:42:50.947260 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947106    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-credential-socket\") pod \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") "
Sep 16 14:42:50.947260 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947134    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-podinfo\") pod \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") "
Sep 16 14:42:50.947260 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947214    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istiod-ca-cert\") pod \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") "
Sep 16 14:42:50.947483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947253    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e4574c3-d459-4a72-bdc6-91ced3cd28b9" (UID: "1e4574c3-d459-4a72-bdc6-91ced3cd28b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:50.947483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947287    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-envoy\") pod \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") "
Sep 16 14:42:50.947483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947335    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-data\") pod \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") "
Sep 16 14:42:50.947483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947376    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-workload-certs\") pod \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\" (UID: \"1e4574c3-d459-4a72-bdc6-91ced3cd28b9\") "
Sep 16 14:42:50.947483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947441    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e4574c3-d459-4a72-bdc6-91ced3cd28b9" (UID: "1e4574c3-d459-4a72-bdc6-91ced3cd28b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:50.947740 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947623    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e4574c3-d459-4a72-bdc6-91ced3cd28b9" (UID: "1e4574c3-d459-4a72-bdc6-91ced3cd28b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:50.947740 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947658    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e4574c3-d459-4a72-bdc6-91ced3cd28b9" (UID: "1e4574c3-d459-4a72-bdc6-91ced3cd28b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:42:50.947740 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947727    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-data\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:50.947911 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947748    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-workload-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:50.947911 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947761    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-credential-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:50.947911 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.947835    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e4574c3-d459-4a72-bdc6-91ced3cd28b9" (UID: "1e4574c3-d459-4a72-bdc6-91ced3cd28b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:50.949379 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.949352    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-kube-api-access-mrbqd" (OuterVolumeSpecName: "kube-api-access-mrbqd") pod "1e4574c3-d459-4a72-bdc6-91ced3cd28b9" (UID: "1e4574c3-d459-4a72-bdc6-91ced3cd28b9"). InnerVolumeSpecName "kube-api-access-mrbqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:42:50.949472 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.949383    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e4574c3-d459-4a72-bdc6-91ced3cd28b9" (UID: "1e4574c3-d459-4a72-bdc6-91ced3cd28b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:42:50.949472 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.949393    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e4574c3-d459-4a72-bdc6-91ced3cd28b9" (UID: "1e4574c3-d459-4a72-bdc6-91ced3cd28b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:42:50.949472 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:50.949413    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e4574c3-d459-4a72-bdc6-91ced3cd28b9" (UID: "1e4574c3-d459-4a72-bdc6-91ced3cd28b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:42:51.048435 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.048408    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-token\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:51.048435 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.048432    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrbqd\" (UniqueName: \"kubernetes.io/projected/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-kube-api-access-mrbqd\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:51.048591 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.048442    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-podinfo\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:51.048591 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.048451    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istiod-ca-cert\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:51.048591 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.048460    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-istio-envoy\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:51.048591 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.048467    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e4574c3-d459-4a72-bdc6-91ced3cd28b9-workload-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:42:51.450118 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.450087    2582 generic.go:356] "Generic (PLEG): container finished" podID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerID="d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8" exitCode=0
Sep 16 14:42:51.450283 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.450145    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"
Sep 16 14:42:51.450283 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.450170    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" event={"ID":"1e4574c3-d459-4a72-bdc6-91ced3cd28b9","Type":"ContainerDied","Data":"d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8"}
Sep 16 14:42:51.450283 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.450223    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t" event={"ID":"1e4574c3-d459-4a72-bdc6-91ced3cd28b9","Type":"ContainerDied","Data":"164f8e453c51a614e83edac38f610cac5e7685c920f8a1b0c5cfc44edc1c9745"}
Sep 16 14:42:51.450283 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.450265    2582 scope.go:117] "RemoveContainer" containerID="d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8"
Sep 16 14:42:51.461527 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.461511    2582 scope.go:117] "RemoveContainer" containerID="00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd"
Sep 16 14:42:51.469511 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.469487    2582 scope.go:117] "RemoveContainer" containerID="d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8"
Sep 16 14:42:51.469935 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:42:51.469743    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8\": container with ID starting with d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8 not found: ID does not exist" containerID="d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8"
Sep 16 14:42:51.469935 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.469771    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8"} err="failed to get container status \"d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8\": rpc error: code = NotFound desc = could not find container \"d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8\": container with ID starting with d46da2a20bc0c6d9df34247b0902f4347b265deaf1d3e8271eb0e34e1d897bb8 not found: ID does not exist"
Sep 16 14:42:51.469935 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.469787    2582 scope.go:117] "RemoveContainer" containerID="00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd"
Sep 16 14:42:51.470323 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:42:51.470181    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd\": container with ID starting with 00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd not found: ID does not exist" containerID="00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd"
Sep 16 14:42:51.470323 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.470213    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd"} err="failed to get container status \"00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd\": rpc error: code = NotFound desc = could not find container \"00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd\": container with ID starting with 00fac9bdaf790b8af4211876eea4d568eb7d91d666299a0f903585d3afbcb8cd not found: ID does not exist"
Sep 16 14:42:51.472847 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.472825    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"]
Sep 16 14:42:51.477182 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:51.477162    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t"]
Sep 16 14:42:53.180483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:42:53.180449    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" path="/var/lib/kubelet/pods/1e4574c3-d459-4a72-bdc6-91ced3cd28b9/volumes"
Sep 16 14:43:04.379322 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:04.379180    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:07.819215 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:07.819167    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:43:26.569808 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:26.569775    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:43:35.574766 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:35.574724    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:35.667554 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:35.667525    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:40.713403 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:40.713368    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:43:50.963698 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:50.963664    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:51.939440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:51.939412    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:53.522654 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:53.522623    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:43:59.626068 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626029    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"]
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626478    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a366cfa-3dcd-4bef-b5c2-4d6a055410c7" containerName="payload-pre-processing"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626498    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a366cfa-3dcd-4bef-b5c2-4d6a055410c7" containerName="payload-pre-processing"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626513    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72b2f75e-f06b-453a-a4d8-61528a5d4934" containerName="payload-processing"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626522    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="72b2f75e-f06b-453a-a4d8-61528a5d4934" containerName="payload-processing"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626540    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerName="istio-proxy"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626549    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerName="istio-proxy"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626561    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626569    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626583    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerName="istio-proxy"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626591    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerName="istio-proxy"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626601    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35a2abc4-3289-419b-94ef-698b10d96441" containerName="main"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626609    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="35a2abc4-3289-419b-94ef-698b10d96441" containerName="main"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626623    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1f8250-0d2c-4a51-b9c3-7fd5120b4419" containerName="payload-pre-processing"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626632    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1f8250-0d2c-4a51-b9c3-7fd5120b4419" containerName="payload-pre-processing"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626645    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9" containerName="main"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626653    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9" containerName="main"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626664    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1e4cdf7-f50c-4b2f-b450-58dcd08bf651" containerName="maas-api"
Sep 16 14:43:59.626659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626672    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1e4cdf7-f50c-4b2f-b450-58dcd08bf651" containerName="maas-api"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626686    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c190e2-3382-40d2-a559-0bf0fb89b6d9" containerName="maas-api"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626694    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c190e2-3382-40d2-a559-0bf0fb89b6d9" containerName="maas-api"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626794    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1e4cdf7-f50c-4b2f-b450-58dcd08bf651" containerName="maas-api"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626804    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ce32a5c-de8e-4bbe-ad9c-50276d1acfa9" containerName="main"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626811    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerName="istio-proxy"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626818    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="35a2abc4-3289-419b-94ef-698b10d96441" containerName="main"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626824    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1f8250-0d2c-4a51-b9c3-7fd5120b4419" containerName="payload-pre-processing"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626831    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e4574c3-d459-4a72-bdc6-91ced3cd28b9" containerName="istio-proxy"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626837    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a366cfa-3dcd-4bef-b5c2-4d6a055410c7" containerName="payload-pre-processing"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626847    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="82c190e2-3382-40d2-a559-0bf0fb89b6d9" containerName="maas-api"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626854    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="72b2f75e-f06b-453a-a4d8-61528a5d4934" containerName="payload-processing"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626859    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy"
Sep 16 14:43:59.627529 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.626864    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy"
Sep 16 14:43:59.629980 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.629961    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.634140 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.634117    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-9f88e1\"/\"kube-root-ca.crt\""
Sep 16 14:43:59.635124 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.635101    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-9f88e1\"/\"rate-test-model-9f88e1-kserve-self-signed-certs\""
Sep 16 14:43:59.635268 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.635149    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-9f88e1\"/\"openshift-service-ca.crt\""
Sep 16 14:43:59.635268 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.635178    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-9f88e1\"/\"default-dockercfg-lt7qm\""
Sep 16 14:43:59.648018 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.647982    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"]
Sep 16 14:43:59.656121 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.656093    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:59.735469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.729833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-home\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.735469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.729949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c4017f6-c85d-4c65-b062-ce98f202230d-tls-certs\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.735469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.729989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmvnh\" (UniqueName: \"kubernetes.io/projected/9c4017f6-c85d-4c65-b062-ce98f202230d-kube-api-access-xmvnh\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.735469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.730042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-model-cache\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.735469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.730096    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-tmp-dir\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.735469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.730146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-dshm\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.831112 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.831076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-home\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.831334 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.831128    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c4017f6-c85d-4c65-b062-ce98f202230d-tls-certs\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.831334 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.831150    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmvnh\" (UniqueName: \"kubernetes.io/projected/9c4017f6-c85d-4c65-b062-ce98f202230d-kube-api-access-xmvnh\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.831334 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.831187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-model-cache\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.831334 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.831204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-tmp-dir\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.831334 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.831254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-dshm\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.831647 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.831555    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-home\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.831647 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.831576    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-tmp-dir\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.831647 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.831629    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-model-cache\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.833511 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.833491    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-dshm\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.833663 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.833645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c4017f6-c85d-4c65-b062-ce98f202230d-tls-certs\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.840059 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.840035    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmvnh\" (UniqueName: \"kubernetes.io/projected/9c4017f6-c85d-4c65-b062-ce98f202230d-kube-api-access-xmvnh\") pod \"rate-test-model-9f88e1-kserve-787c4c95-82nzz\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") " pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:43:59.939483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:43:59.939419    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:44:00.209970 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:44:00.209947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"]
Sep 16 14:44:00.212431 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:44:00.212398    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c4017f6_c85d_4c65_b062_ce98f202230d.slice/crio-f2c3ae6975ec07850f30298641a20badfae4bff384294f1becd172587a925d19 WatchSource:0}: Error finding container f2c3ae6975ec07850f30298641a20badfae4bff384294f1becd172587a925d19: Status 404 returned error can't find the container with id f2c3ae6975ec07850f30298641a20badfae4bff384294f1becd172587a925d19
Sep 16 14:44:00.814622 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:44:00.814586    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz" event={"ID":"9c4017f6-c85d-4c65-b062-ce98f202230d","Type":"ContainerStarted","Data":"b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f"}
Sep 16 14:44:00.815022 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:44:00.814633    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz" event={"ID":"9c4017f6-c85d-4c65-b062-ce98f202230d","Type":"ContainerStarted","Data":"f2c3ae6975ec07850f30298641a20badfae4bff384294f1becd172587a925d19"}
Sep 16 14:44:00.833549 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:44:00.833507    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz" podStartSLOduration=1.833485882 podStartE2EDuration="1.833485882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:43:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:44:00.832856793 +0000 UTC m=+1760.126545286" watchObservedRunningTime="2026-09-16 14:44:00.833485882 +0000 UTC m=+1760.127174362"
Sep 16 14:44:03.320781 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:44:03.320746    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:44:09.940026 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:44:09.939992    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:44:09.940459 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:44:09.940051    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:44:09.952266 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:44:09.952231    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:44:10.880304 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:44:10.880277    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:44:27.368899 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:44:27.368864    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:31.008662 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:44:31.008627    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:44:54.815098 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:44:54.815062    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:45:04.615096 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:04.615064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:45:10.926868 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:10.926831    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"]
Sep 16 14:45:10.937915 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:10.937886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:12.926898 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:12.926865    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:13.003579 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:13.003541    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:15.334986 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:15.334945    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:15.616288 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:15.616200    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:45:16.003213 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:16.003142    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:16.102947 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:16.102914    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:16.203203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:16.203173    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:17.201937 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:17.201900    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:17.981412 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:17.981376    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"]
Sep 16 14:45:17.981780 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:17.981766    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy"
Sep 16 14:45:17.981850 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:17.981783    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40e824f-371d-4ffd-9a4a-bc456034ae9f" containerName="istio-proxy"
Sep 16 14:45:17.984888 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:17.984866    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:17.987873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:17.987853    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-a70ddb-serving-cert\""
Sep 16 14:45:17.996643 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:17.996619    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"]
Sep 16 14:45:18.017872 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.017844    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:18.089038 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.089005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:18.105933 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.105906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.105933 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.105938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9mvp\" (UniqueName: \"kubernetes.io/projected/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-kube-api-access-d9mvp\") pod \"maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.106142 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.106050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.106142 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.106082    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-metrics-certs\") pod \"maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.207508 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.207474    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.207508 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.207510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-metrics-certs\") pod \"maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.207943 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.207549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.207943 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.207571    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9mvp\" (UniqueName: \"kubernetes.io/projected/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-kube-api-access-d9mvp\") pod \"maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.208307 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.208288    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.210026 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.210003    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-metrics-certs\") pod \"maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.210137 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.210070    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.216711 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.216688    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9mvp\" (UniqueName: \"kubernetes.io/projected/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-kube-api-access-d9mvp\") pod \"maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.230033 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.230008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:18.296676 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.296655    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:18.530595 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.530563    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:18.582227 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.582201    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"]
Sep 16 14:45:18.584181 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:45:18.584138    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2aaad27_2567_48ee_80c0_5c7e7f67f6c5.slice/crio-8098b0782a64184dafae0709d0539529e79ab4689c39b014c3a0821a90cffe0f WatchSource:0}: Error finding container 8098b0782a64184dafae0709d0539529e79ab4689c39b014c3a0821a90cffe0f: Status 404 returned error can't find the container with id 8098b0782a64184dafae0709d0539529e79ab4689c39b014c3a0821a90cffe0f
Sep 16 14:45:18.585602 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.585582    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:45:18.628246 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.628212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:18.711830 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.711797    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"]
Sep 16 14:45:18.716169 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.716147    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"
Sep 16 14:45:18.719042 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.719022    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-a70ddb\""
Sep 16 14:45:18.719282 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.719265    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-a70ddb-dockercfg-j4zk2\""
Sep 16 14:45:18.728633 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.728608    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"]
Sep 16 14:45:18.813862 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.813826    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmqfg\" (UniqueName: \"kubernetes.io/projected/46b765b7-bc8b-4a97-806e-36f6bd70d2cf-kube-api-access-lmqfg\") pod \"payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7\" (UID: \"46b765b7-bc8b-4a97-806e-36f6bd70d2cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"
Sep 16 14:45:18.814279 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.814229    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46b765b7-bc8b-4a97-806e-36f6bd70d2cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7\" (UID: \"46b765b7-bc8b-4a97-806e-36f6bd70d2cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"
Sep 16 14:45:18.921383 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.915554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46b765b7-bc8b-4a97-806e-36f6bd70d2cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7\" (UID: \"46b765b7-bc8b-4a97-806e-36f6bd70d2cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"
Sep 16 14:45:18.921383 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.915654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmqfg\" (UniqueName: \"kubernetes.io/projected/46b765b7-bc8b-4a97-806e-36f6bd70d2cf-kube-api-access-lmqfg\") pod \"payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7\" (UID: \"46b765b7-bc8b-4a97-806e-36f6bd70d2cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"
Sep 16 14:45:18.921383 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.916809    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46b765b7-bc8b-4a97-806e-36f6bd70d2cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7\" (UID: \"46b765b7-bc8b-4a97-806e-36f6bd70d2cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"
Sep 16 14:45:18.925800 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:18.925772    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmqfg\" (UniqueName: \"kubernetes.io/projected/46b765b7-bc8b-4a97-806e-36f6bd70d2cf-kube-api-access-lmqfg\") pod \"payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7\" (UID: \"46b765b7-bc8b-4a97-806e-36f6bd70d2cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"
Sep 16 14:45:19.027589 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:19.027557    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"
Sep 16 14:45:19.236620 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:19.236540    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8" event={"ID":"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5","Type":"ContainerStarted","Data":"efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020"}
Sep 16 14:45:19.236620 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:19.236596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8" event={"ID":"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5","Type":"ContainerStarted","Data":"8098b0782a64184dafae0709d0539529e79ab4689c39b014c3a0821a90cffe0f"}
Sep 16 14:45:19.237005 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:19.236637    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:19.259163 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:19.259120    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8" podStartSLOduration=1.742811055 podStartE2EDuration="2.259107048s" totalImagesPullingTime="516.295993ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:45:19.256477476 +0000 UTC m=+1838.550165955" watchObservedRunningTime="2026-09-16 14:45:19.259107048 +0000 UTC m=+1838.552795592"
Sep 16 14:45:19.300851 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:19.300829    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"]
Sep 16 14:45:19.302976 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:45:19.302946    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b765b7_bc8b_4a97_806e_36f6bd70d2cf.slice/crio-059ab416775c4318b74aa06794c1ef5f33809dcde9784f1fc793b7a176965f0c WatchSource:0}: Error finding container 059ab416775c4318b74aa06794c1ef5f33809dcde9784f1fc793b7a176965f0c: Status 404 returned error can't find the container with id 059ab416775c4318b74aa06794c1ef5f33809dcde9784f1fc793b7a176965f0c
Sep 16 14:45:20.243821 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:20.243772    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7" event={"ID":"46b765b7-bc8b-4a97-806e-36f6bd70d2cf","Type":"ContainerStarted","Data":"c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1"}
Sep 16 14:45:20.244275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:20.243962    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"
Sep 16 14:45:20.244275 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:20.244010    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7" event={"ID":"46b765b7-bc8b-4a97-806e-36f6bd70d2cf","Type":"ContainerStarted","Data":"059ab416775c4318b74aa06794c1ef5f33809dcde9784f1fc793b7a176965f0c"}
Sep 16 14:45:20.263887 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:20.263839    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7" podStartSLOduration=2.263823512 podStartE2EDuration="2.263823512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:45:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:45:20.261334976 +0000 UTC m=+1839.555023459" watchObservedRunningTime="2026-09-16 14:45:20.263823512 +0000 UTC m=+1839.557511988"
Sep 16 14:45:25.249679 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:25.249649    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:45:25.945229 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:25.945165    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz" podUID="9c4017f6-c85d-4c65-b062-ce98f202230d" containerName="main" containerID="cri-o://b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f" gracePeriod=45
Sep 16 14:45:26.190179 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.190153    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:45:26.272998 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.272926    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-tmp-dir\") pod \"9c4017f6-c85d-4c65-b062-ce98f202230d\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") "
Sep 16 14:45:26.272998 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.272964    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmvnh\" (UniqueName: \"kubernetes.io/projected/9c4017f6-c85d-4c65-b062-ce98f202230d-kube-api-access-xmvnh\") pod \"9c4017f6-c85d-4c65-b062-ce98f202230d\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") "
Sep 16 14:45:26.272998 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.272994    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c4017f6-c85d-4c65-b062-ce98f202230d-tls-certs\") pod \"9c4017f6-c85d-4c65-b062-ce98f202230d\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") "
Sep 16 14:45:26.273561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.273015    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-dshm\") pod \"9c4017f6-c85d-4c65-b062-ce98f202230d\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") "
Sep 16 14:45:26.273561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.273141    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-home\") pod \"9c4017f6-c85d-4c65-b062-ce98f202230d\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") "
Sep 16 14:45:26.273561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.273176    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-model-cache\") pod \"9c4017f6-c85d-4c65-b062-ce98f202230d\" (UID: \"9c4017f6-c85d-4c65-b062-ce98f202230d\") "
Sep 16 14:45:26.273561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.273219    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9c4017f6-c85d-4c65-b062-ce98f202230d" (UID: "9c4017f6-c85d-4c65-b062-ce98f202230d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:45:26.273561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.273494    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-home" (OuterVolumeSpecName: "home") pod "9c4017f6-c85d-4c65-b062-ce98f202230d" (UID: "9c4017f6-c85d-4c65-b062-ce98f202230d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:45:26.273561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.273509    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-tmp-dir\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:45:26.273561 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.273513    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-model-cache" (OuterVolumeSpecName: "model-cache") pod "9c4017f6-c85d-4c65-b062-ce98f202230d" (UID: "9c4017f6-c85d-4c65-b062-ce98f202230d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:45:26.275313 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.275286    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c4017f6-c85d-4c65-b062-ce98f202230d-kube-api-access-xmvnh" (OuterVolumeSpecName: "kube-api-access-xmvnh") pod "9c4017f6-c85d-4c65-b062-ce98f202230d" (UID: "9c4017f6-c85d-4c65-b062-ce98f202230d"). InnerVolumeSpecName "kube-api-access-xmvnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:45:26.275430 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.275309    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-dshm" (OuterVolumeSpecName: "dshm") pod "9c4017f6-c85d-4c65-b062-ce98f202230d" (UID: "9c4017f6-c85d-4c65-b062-ce98f202230d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:45:26.275430 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.275361    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c4017f6-c85d-4c65-b062-ce98f202230d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9c4017f6-c85d-4c65-b062-ce98f202230d" (UID: "9c4017f6-c85d-4c65-b062-ce98f202230d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:45:26.278343 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.278318    2582 generic.go:356] "Generic (PLEG): container finished" podID="9c4017f6-c85d-4c65-b062-ce98f202230d" containerID="b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f" exitCode=0
Sep 16 14:45:26.278461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.278368    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"
Sep 16 14:45:26.278461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.278396    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz" event={"ID":"9c4017f6-c85d-4c65-b062-ce98f202230d","Type":"ContainerDied","Data":"b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f"}
Sep 16 14:45:26.278461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.278443    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz" event={"ID":"9c4017f6-c85d-4c65-b062-ce98f202230d","Type":"ContainerDied","Data":"f2c3ae6975ec07850f30298641a20badfae4bff384294f1becd172587a925d19"}
Sep 16 14:45:26.278461 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.278461    2582 scope.go:117] "RemoveContainer" containerID="b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f"
Sep 16 14:45:26.292886 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.292868    2582 scope.go:117] "RemoveContainer" containerID="b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f"
Sep 16 14:45:26.293175 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:45:26.293148    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f\": container with ID starting with b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f not found: ID does not exist" containerID="b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f"
Sep 16 14:45:26.293265 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.293190    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f"} err="failed to get container status \"b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f\": rpc error: code = NotFound desc = could not find container \"b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f\": container with ID starting with b900358e40e0a8432e232a8262322f21a59489a080e306ffc3441a97e01c2a5f not found: ID does not exist"
Sep 16 14:45:26.303759 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.303736    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"]
Sep 16 14:45:26.307213 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.307193    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-9f88e1/rate-test-model-9f88e1-kserve-787c4c95-82nzz"]
Sep 16 14:45:26.374612 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.374590    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmvnh\" (UniqueName: \"kubernetes.io/projected/9c4017f6-c85d-4c65-b062-ce98f202230d-kube-api-access-xmvnh\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:45:26.374612 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.374614    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c4017f6-c85d-4c65-b062-ce98f202230d-tls-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:45:26.374738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.374624    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-dshm\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:45:26.374738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.374631    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-home\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:45:26.374738 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:26.374640    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c4017f6-c85d-4c65-b062-ce98f202230d-model-cache\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:45:27.179698 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:27.179665    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c4017f6-c85d-4c65-b062-ce98f202230d" path="/var/lib/kubelet/pods/9c4017f6-c85d-4c65-b062-ce98f202230d/volumes"
Sep 16 14:45:28.018023 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:28.017987    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:45:31.251396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:31.251368    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"
Sep 16 14:45:40.103072 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:40.103023    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:40.829463 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:40.829423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:41.053679 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:41.053634    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:41.591625 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:41.591585    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:41.712483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:41.712450    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:42.036676 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:42.036642    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:42.204993 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:42.204944    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:42.635712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:42.635678    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:44.495765 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:44.495726    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:45.202494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:45.202460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:45.301693 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:45.301658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:45.406908 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:45.406876    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:46.024713 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:46.024677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:46.758202 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:46.758161    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:47.574058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.574024    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"]
Sep 16 14:45:47.574638 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.574610    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c4017f6-c85d-4c65-b062-ce98f202230d" containerName="main"
Sep 16 14:45:47.574638 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.574632    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c4017f6-c85d-4c65-b062-ce98f202230d" containerName="main"
Sep 16 14:45:47.574782 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.574723    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c4017f6-c85d-4c65-b062-ce98f202230d" containerName="main"
Sep 16 14:45:47.577773 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.577752    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:47.580586 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.580564    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-3eaa3c-serving-cert\""
Sep 16 14:45:47.591376 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.591351    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"]
Sep 16 14:45:47.611014 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.610992    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:47.663194 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.663169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-metrics-certs\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:47.663321 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.663262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:47.663321 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.663296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea80e197-861d-4955-94d2-a815ac6bbea1-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:47.663423 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.663340    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxfwv\" (UniqueName: \"kubernetes.io/projected/ea80e197-861d-4955-94d2-a815ac6bbea1-kube-api-access-cxfwv\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:47.710780 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.710744    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:47.763986 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.763960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:47.764117 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.763997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea80e197-861d-4955-94d2-a815ac6bbea1-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:47.764117 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.764025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxfwv\" (UniqueName: \"kubernetes.io/projected/ea80e197-861d-4955-94d2-a815ac6bbea1-kube-api-access-cxfwv\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:47.764117 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.764059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-metrics-certs\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:47.764328 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:45:47.764136    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-serving-cert: secret "maas-api-e2e-ipp-b-3eaa3c-serving-cert" not found
Sep 16 14:45:47.764328 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:45:47.764227    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-maas-api-tls podName:ea80e197-861d-4955-94d2-a815ac6bbea1 nodeName:}" failed. No retries permitted until 2026-09-16 14:45:48.264203682 +0000 UTC m=+1867.557892155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-maas-api-tls") pod "maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf" (UID: "ea80e197-861d-4955-94d2-a815ac6bbea1") : secret "maas-api-e2e-ipp-b-3eaa3c-serving-cert" not found
Sep 16 14:45:47.764656 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.764635    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea80e197-861d-4955-94d2-a815ac6bbea1-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:47.766546 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.766524    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-metrics-certs\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:47.772631 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:47.772603    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxfwv\" (UniqueName: \"kubernetes.io/projected/ea80e197-861d-4955-94d2-a815ac6bbea1-kube-api-access-cxfwv\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:48.014198 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:48.014116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:48.192557 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:48.192528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:48.269510 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:48.269431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:48.271789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:48.271765    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:48.293608 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:48.293575    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:48.488554 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:48.488525    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:48.767948 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:48.767922    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"]
Sep 16 14:45:48.769635 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:45:48.769610    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea80e197_861d_4955_94d2_a815ac6bbea1.slice/crio-abf99a0997a460b17cc1d00dfaaf07afaf3ad5643dc9fbd97aa22d750c00022b WatchSource:0}: Error finding container abf99a0997a460b17cc1d00dfaaf07afaf3ad5643dc9fbd97aa22d750c00022b: Status 404 returned error can't find the container with id abf99a0997a460b17cc1d00dfaaf07afaf3ad5643dc9fbd97aa22d750c00022b
Sep 16 14:45:49.404933 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:49.404899    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf" event={"ID":"ea80e197-861d-4955-94d2-a815ac6bbea1","Type":"ContainerStarted","Data":"fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d"}
Sep 16 14:45:49.405096 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:49.404948    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf" event={"ID":"ea80e197-861d-4955-94d2-a815ac6bbea1","Type":"ContainerStarted","Data":"abf99a0997a460b17cc1d00dfaaf07afaf3ad5643dc9fbd97aa22d750c00022b"}
Sep 16 14:45:49.405096 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:49.405038    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:45:49.428507 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:49.428454    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf" podStartSLOduration=1.967621369 podStartE2EDuration="2.428439131s" totalImagesPullingTime="460.817762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:45:49.426772753 +0000 UTC m=+1868.720461232" watchObservedRunningTime="2026-09-16 14:45:49.428439131 +0000 UTC m=+1868.722127609"
Sep 16 14:45:52.820841 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:52.820804    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:45:55.416482 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:45:55.416452    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:46:01.996063 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:01.996024    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:08.647936 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:08.647895    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:09.853108 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:09.853066    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:10.211338 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:10.211258    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:10.664214 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:10.664171    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:11.494392 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:11.494361    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:12.206654 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:12.206620    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:13.019033 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:13.018990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:26.610598 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:26.610564    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:30.826672 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:30.826630    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:46:33.280447 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:33.280410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:36.720490 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:36.720460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:36.820407 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:36.820375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:38.735682 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:38.735645    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:44.920592 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:44.920557    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:46:51.884769 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:51.884737    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:52.196199 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:52.196124    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:52.459366 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:52.459289    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:54.886364 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:54.886332    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:55.576459 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:55.576425    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:55.671147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:55.671119    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:55.772663 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:55.772626    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:56.603166 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:56.603137    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:57.326138 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:57.326105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:58.329973 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:58.329927    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:59.037465 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.037429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:59.135789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.135754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:59.293791 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.293708    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:59.534619 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.534588    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:59.634096 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.634024    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:59.648125 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.648094    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"]
Sep 16 14:46:59.651469 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.651448    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"
Sep 16 14:46:59.655455 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.655434    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-a26a50\""
Sep 16 14:46:59.655594 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.655480    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-a26a50-dockercfg-wrqd9\""
Sep 16 14:46:59.661600 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.661369    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"]
Sep 16 14:46:59.665512 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.665489    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"]
Sep 16 14:46:59.665615 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.665599    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"
Sep 16 14:46:59.676091 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.676067    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"]
Sep 16 14:46:59.789043 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.789013    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9e38e40-32d3-402a-97d3-439507889b56-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2\" (UID: \"b9e38e40-32d3-402a-97d3-439507889b56\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"
Sep 16 14:46:59.789209 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.789052    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q99xp\" (UniqueName: \"kubernetes.io/projected/b9e38e40-32d3-402a-97d3-439507889b56-kube-api-access-q99xp\") pod \"payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2\" (UID: \"b9e38e40-32d3-402a-97d3-439507889b56\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"
Sep 16 14:46:59.789209 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.789119    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbt6w\" (UniqueName: \"kubernetes.io/projected/d047b611-ebfd-442e-8ef6-9e4e0e351a0e-kube-api-access-jbt6w\") pod \"payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf\" (UID: \"d047b611-ebfd-442e-8ef6-9e4e0e351a0e\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"
Sep 16 14:46:59.789209 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.789152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d047b611-ebfd-442e-8ef6-9e4e0e351a0e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf\" (UID: \"d047b611-ebfd-442e-8ef6-9e4e0e351a0e\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"
Sep 16 14:46:59.890625 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.890549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9e38e40-32d3-402a-97d3-439507889b56-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2\" (UID: \"b9e38e40-32d3-402a-97d3-439507889b56\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"
Sep 16 14:46:59.890625 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.890586    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q99xp\" (UniqueName: \"kubernetes.io/projected/b9e38e40-32d3-402a-97d3-439507889b56-kube-api-access-q99xp\") pod \"payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2\" (UID: \"b9e38e40-32d3-402a-97d3-439507889b56\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"
Sep 16 14:46:59.890848 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.890636    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbt6w\" (UniqueName: \"kubernetes.io/projected/d047b611-ebfd-442e-8ef6-9e4e0e351a0e-kube-api-access-jbt6w\") pod \"payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf\" (UID: \"d047b611-ebfd-442e-8ef6-9e4e0e351a0e\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"
Sep 16 14:46:59.890848 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.890665    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d047b611-ebfd-442e-8ef6-9e4e0e351a0e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf\" (UID: \"d047b611-ebfd-442e-8ef6-9e4e0e351a0e\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"
Sep 16 14:46:59.891301 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.891283    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9e38e40-32d3-402a-97d3-439507889b56-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2\" (UID: \"b9e38e40-32d3-402a-97d3-439507889b56\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"
Sep 16 14:46:59.891400 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.891384    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d047b611-ebfd-442e-8ef6-9e4e0e351a0e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf\" (UID: \"d047b611-ebfd-442e-8ef6-9e4e0e351a0e\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"
Sep 16 14:46:59.899768 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.899743    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbt6w\" (UniqueName: \"kubernetes.io/projected/d047b611-ebfd-442e-8ef6-9e4e0e351a0e-kube-api-access-jbt6w\") pod \"payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf\" (UID: \"d047b611-ebfd-442e-8ef6-9e4e0e351a0e\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"
Sep 16 14:46:59.899881 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.899743    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q99xp\" (UniqueName: \"kubernetes.io/projected/b9e38e40-32d3-402a-97d3-439507889b56-kube-api-access-q99xp\") pod \"payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2\" (UID: \"b9e38e40-32d3-402a-97d3-439507889b56\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"
Sep 16 14:46:59.963101 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.963077    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"
Sep 16 14:46:59.976349 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:46:59.976322    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"
Sep 16 14:47:00.241272 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:00.241247    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"]
Sep 16 14:47:00.242541 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:47:00.242513    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e38e40_32d3_402a_97d3_439507889b56.slice/crio-824f586a4df886523fe67868d1d90ee5e99c4578e2b1e94b6a336ac9d23c3be7 WatchSource:0}: Error finding container 824f586a4df886523fe67868d1d90ee5e99c4578e2b1e94b6a336ac9d23c3be7: Status 404 returned error can't find the container with id 824f586a4df886523fe67868d1d90ee5e99c4578e2b1e94b6a336ac9d23c3be7
Sep 16 14:47:00.266568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:00.266543    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"]
Sep 16 14:47:00.279353 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:47:00.279323    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd047b611_ebfd_442e_8ef6_9e4e0e351a0e.slice/crio-efb3c533bc584eaed3399baa81100a12645cdf25dedf2fb95e30484f72a64fbc WatchSource:0}: Error finding container efb3c533bc584eaed3399baa81100a12645cdf25dedf2fb95e30484f72a64fbc: Status 404 returned error can't find the container with id efb3c533bc584eaed3399baa81100a12645cdf25dedf2fb95e30484f72a64fbc
Sep 16 14:47:00.794576 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:00.794537    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf" event={"ID":"d047b611-ebfd-442e-8ef6-9e4e0e351a0e","Type":"ContainerStarted","Data":"5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3"}
Sep 16 14:47:00.795054 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:00.794606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf" event={"ID":"d047b611-ebfd-442e-8ef6-9e4e0e351a0e","Type":"ContainerStarted","Data":"efb3c533bc584eaed3399baa81100a12645cdf25dedf2fb95e30484f72a64fbc"}
Sep 16 14:47:00.795054 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:00.794637    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"
Sep 16 14:47:00.796586 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:00.796557    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2" event={"ID":"b9e38e40-32d3-402a-97d3-439507889b56","Type":"ContainerStarted","Data":"7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace"}
Sep 16 14:47:00.796919 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:00.796604    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2" event={"ID":"b9e38e40-32d3-402a-97d3-439507889b56","Type":"ContainerStarted","Data":"824f586a4df886523fe67868d1d90ee5e99c4578e2b1e94b6a336ac9d23c3be7"}
Sep 16 14:47:00.796919 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:00.796633    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"
Sep 16 14:47:00.814003 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:00.813955    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf" podStartSLOduration=1.8139373600000002 podStartE2EDuration="1.81393736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:46:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:47:00.812552137 +0000 UTC m=+1940.106240618" watchObservedRunningTime="2026-09-16 14:47:00.81393736 +0000 UTC m=+1940.107625838"
Sep 16 14:47:00.829185 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:00.829144    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2" podStartSLOduration=1.829130767 podStartE2EDuration="1.829130767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:46:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:47:00.829026753 +0000 UTC m=+1940.122715232" watchObservedRunningTime="2026-09-16 14:47:00.829130767 +0000 UTC m=+1940.122819245"
Sep 16 14:47:04.516576 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:04.516538    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:47:11.805276 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:11.805228    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"
Sep 16 14:47:11.805639 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:11.805324    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"
Sep 16 14:47:21.107091 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:21.107055    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:21.788396 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:21.788355    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:22.388847 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:22.388820    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:22.457008 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:22.456979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:22.573103 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:22.573075    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:23.307849 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:23.307796    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:23.949387 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:23.949352    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:24.725429 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:24.725393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:25.778542 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:25.778504    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:27.205052 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:27.205015    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:28.001770 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:28.001735    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:28.673473 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:28.673438    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:29.521510 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:29.521470    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:30.293472 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:30.293436    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:31.054577 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:31.054544    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:37.321091 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.321018    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:37.353959 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.353924    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"]
Sep 16 14:47:37.354256 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.354208    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2" podUID="b9e38e40-32d3-402a-97d3-439507889b56" containerName="payload-pre-processing" containerID="cri-o://7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace" gracePeriod=30
Sep 16 14:47:37.358163 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.358135    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"]
Sep 16 14:47:37.358588 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.358554    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf" podUID="d047b611-ebfd-442e-8ef6-9e4e0e351a0e" containerName="payload-processing" containerID="cri-o://5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3" gracePeriod=30
Sep 16 14:47:37.400999 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.400972    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:37.465142 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.465105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:37.568537 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.568497    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:37.645744 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.645720    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"
Sep 16 14:47:37.648678 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.648659    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"
Sep 16 14:47:37.823856 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.823822    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbt6w\" (UniqueName: \"kubernetes.io/projected/d047b611-ebfd-442e-8ef6-9e4e0e351a0e-kube-api-access-jbt6w\") pod \"d047b611-ebfd-442e-8ef6-9e4e0e351a0e\" (UID: \"d047b611-ebfd-442e-8ef6-9e4e0e351a0e\") "
Sep 16 14:47:37.823856 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.823861    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d047b611-ebfd-442e-8ef6-9e4e0e351a0e-plugins-config-volume\") pod \"d047b611-ebfd-442e-8ef6-9e4e0e351a0e\" (UID: \"d047b611-ebfd-442e-8ef6-9e4e0e351a0e\") "
Sep 16 14:47:37.824075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.823936    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q99xp\" (UniqueName: \"kubernetes.io/projected/b9e38e40-32d3-402a-97d3-439507889b56-kube-api-access-q99xp\") pod \"b9e38e40-32d3-402a-97d3-439507889b56\" (UID: \"b9e38e40-32d3-402a-97d3-439507889b56\") "
Sep 16 14:47:37.824075 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.823962    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9e38e40-32d3-402a-97d3-439507889b56-plugins-config-volume\") pod \"b9e38e40-32d3-402a-97d3-439507889b56\" (UID: \"b9e38e40-32d3-402a-97d3-439507889b56\") "
Sep 16 14:47:37.824361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.824325    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9e38e40-32d3-402a-97d3-439507889b56-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b9e38e40-32d3-402a-97d3-439507889b56" (UID: "b9e38e40-32d3-402a-97d3-439507889b56"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:47:37.824361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.824325    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d047b611-ebfd-442e-8ef6-9e4e0e351a0e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d047b611-ebfd-442e-8ef6-9e4e0e351a0e" (UID: "d047b611-ebfd-442e-8ef6-9e4e0e351a0e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:47:37.826016 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.825991    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d047b611-ebfd-442e-8ef6-9e4e0e351a0e-kube-api-access-jbt6w" (OuterVolumeSpecName: "kube-api-access-jbt6w") pod "d047b611-ebfd-442e-8ef6-9e4e0e351a0e" (UID: "d047b611-ebfd-442e-8ef6-9e4e0e351a0e"). InnerVolumeSpecName "kube-api-access-jbt6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:47:37.826100 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.826018    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e38e40-32d3-402a-97d3-439507889b56-kube-api-access-q99xp" (OuterVolumeSpecName: "kube-api-access-q99xp") pod "b9e38e40-32d3-402a-97d3-439507889b56" (UID: "b9e38e40-32d3-402a-97d3-439507889b56"). InnerVolumeSpecName "kube-api-access-q99xp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:47:37.903261 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.903129    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:37.925394 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.925364    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbt6w\" (UniqueName: \"kubernetes.io/projected/d047b611-ebfd-442e-8ef6-9e4e0e351a0e-kube-api-access-jbt6w\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:47:37.925394 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.925392    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d047b611-ebfd-442e-8ef6-9e4e0e351a0e-plugins-config-volume\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:47:37.925547 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.925406    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q99xp\" (UniqueName: \"kubernetes.io/projected/b9e38e40-32d3-402a-97d3-439507889b56-kube-api-access-q99xp\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:47:37.925547 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:37.925421    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9e38e40-32d3-402a-97d3-439507889b56-plugins-config-volume\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:47:38.004061 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.004020    2582 generic.go:356] "Generic (PLEG): container finished" podID="b9e38e40-32d3-402a-97d3-439507889b56" containerID="7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace" exitCode=0
Sep 16 14:47:38.004215 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.004074    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"
Sep 16 14:47:38.004215 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.004110    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2" event={"ID":"b9e38e40-32d3-402a-97d3-439507889b56","Type":"ContainerDied","Data":"7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace"}
Sep 16 14:47:38.004215 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.004169    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2" event={"ID":"b9e38e40-32d3-402a-97d3-439507889b56","Type":"ContainerDied","Data":"824f586a4df886523fe67868d1d90ee5e99c4578e2b1e94b6a336ac9d23c3be7"}
Sep 16 14:47:38.004215 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.004194    2582 scope.go:117] "RemoveContainer" containerID="7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace"
Sep 16 14:47:38.005712 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.005686    2582 generic.go:356] "Generic (PLEG): container finished" podID="d047b611-ebfd-442e-8ef6-9e4e0e351a0e" containerID="5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3" exitCode=0
Sep 16 14:47:38.005830 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.005740    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"
Sep 16 14:47:38.005830 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.005762    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf" event={"ID":"d047b611-ebfd-442e-8ef6-9e4e0e351a0e","Type":"ContainerDied","Data":"5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3"}
Sep 16 14:47:38.005830 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.005806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf" event={"ID":"d047b611-ebfd-442e-8ef6-9e4e0e351a0e","Type":"ContainerDied","Data":"efb3c533bc584eaed3399baa81100a12645cdf25dedf2fb95e30484f72a64fbc"}
Sep 16 14:47:38.014875 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.014859    2582 scope.go:117] "RemoveContainer" containerID="7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace"
Sep 16 14:47:38.015136 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:47:38.015116    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace\": container with ID starting with 7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace not found: ID does not exist" containerID="7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace"
Sep 16 14:47:38.015194 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.015143    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace"} err="failed to get container status \"7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace\": rpc error: code = NotFound desc = could not find container \"7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace\": container with ID starting with 7fdd18537cac88e1f7dc89bf6e5884b612a63ff1a93adf08bc44a14c2760bace not found: ID does not exist"
Sep 16 14:47:38.015194 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.015160    2582 scope.go:117] "RemoveContainer" containerID="5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3"
Sep 16 14:47:38.028925 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.028903    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"]
Sep 16 14:47:38.029111 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.029096    2582 scope.go:117] "RemoveContainer" containerID="5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3"
Sep 16 14:47:38.029418 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:47:38.029398    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3\": container with ID starting with 5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3 not found: ID does not exist" containerID="5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3"
Sep 16 14:47:38.029479 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.029426    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3"} err="failed to get container status \"5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3\": rpc error: code = NotFound desc = could not find container \"5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3\": container with ID starting with 5cf336ca8c974386adb88811952fbeb61167b5cc2207689a6a2ea95beb9759c3 not found: ID does not exist"
Sep 16 14:47:38.032503 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.032479    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2"]
Sep 16 14:47:38.043405 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.043381    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"]
Sep 16 14:47:38.048657 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.048634    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf"]
Sep 16 14:47:38.056438 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.056418    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:38.646097 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:38.645998    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:39.180067 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:39.180033    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9e38e40-32d3-402a-97d3-439507889b56" path="/var/lib/kubelet/pods/b9e38e40-32d3-402a-97d3-439507889b56/volumes"
Sep 16 14:47:39.180454 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:39.180440    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d047b611-ebfd-442e-8ef6-9e4e0e351a0e" path="/var/lib/kubelet/pods/d047b611-ebfd-442e-8ef6-9e4e0e351a0e/volumes"
Sep 16 14:47:39.499287 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:39.499184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:40.259130 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:40.259092    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:41.044354 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:41.044327    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:41.730686 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:41.728435    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:47:43.877499 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:43.877455    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:43.978700 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:43.978663    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:44.144339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:44.144228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:48.274860 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:48.274826    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:49.173784 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:49.173744    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:50.001479 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:50.001448    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:50.648795 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:50.648759    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:51.326250 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:51.326213    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:52.168434 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:47:52.168394    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:01.410960 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:01.410926    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:48:03.513535 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.513502    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"]
Sep 16 14:48:03.514187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.513752    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8" podUID="a2aaad27-2567-48ee-80c0-5c7e7f67f6c5" containerName="maas-api" containerID="cri-o://efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020" gracePeriod=30
Sep 16 14:48:03.548841 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.548808    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:03.581631 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.581598    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"]
Sep 16 14:48:03.581851 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.581826    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7" podUID="46b765b7-bc8b-4a97-806e-36f6bd70d2cf" containerName="payload-pre-processing" containerID="cri-o://c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1" gracePeriod=30
Sep 16 14:48:03.678278 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.678230    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:03.770650 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.770546    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:03.842459 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.842419    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:03.847432 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.847403    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:48:03.879763 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.879738    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"
Sep 16 14:48:03.957889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.957861    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmqfg\" (UniqueName: \"kubernetes.io/projected/46b765b7-bc8b-4a97-806e-36f6bd70d2cf-kube-api-access-lmqfg\") pod \"46b765b7-bc8b-4a97-806e-36f6bd70d2cf\" (UID: \"46b765b7-bc8b-4a97-806e-36f6bd70d2cf\") "
Sep 16 14:48:03.958043 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.957901    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-openshift-service-ca\") pod \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") "
Sep 16 14:48:03.958043 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.957930    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9mvp\" (UniqueName: \"kubernetes.io/projected/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-kube-api-access-d9mvp\") pod \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") "
Sep 16 14:48:03.958145 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.958047    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-metrics-certs\") pod \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") "
Sep 16 14:48:03.958145 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.958090    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46b765b7-bc8b-4a97-806e-36f6bd70d2cf-plugins-config-volume\") pod \"46b765b7-bc8b-4a97-806e-36f6bd70d2cf\" (UID: \"46b765b7-bc8b-4a97-806e-36f6bd70d2cf\") "
Sep 16 14:48:03.958283 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.958161    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-maas-api-tls\") pod \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\" (UID: \"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5\") "
Sep 16 14:48:03.958283 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.958230    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a2aaad27-2567-48ee-80c0-5c7e7f67f6c5" (UID: "a2aaad27-2567-48ee-80c0-5c7e7f67f6c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:48:03.958490 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.958470    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:48:03.958603 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.958578    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46b765b7-bc8b-4a97-806e-36f6bd70d2cf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "46b765b7-bc8b-4a97-806e-36f6bd70d2cf" (UID: "46b765b7-bc8b-4a97-806e-36f6bd70d2cf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:48:03.960159 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.960127    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b765b7-bc8b-4a97-806e-36f6bd70d2cf-kube-api-access-lmqfg" (OuterVolumeSpecName: "kube-api-access-lmqfg") pod "46b765b7-bc8b-4a97-806e-36f6bd70d2cf" (UID: "46b765b7-bc8b-4a97-806e-36f6bd70d2cf"). InnerVolumeSpecName "kube-api-access-lmqfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:48:03.960286 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.960165    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a2aaad27-2567-48ee-80c0-5c7e7f67f6c5" (UID: "a2aaad27-2567-48ee-80c0-5c7e7f67f6c5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:48:03.960286 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.960208    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-kube-api-access-d9mvp" (OuterVolumeSpecName: "kube-api-access-d9mvp") pod "a2aaad27-2567-48ee-80c0-5c7e7f67f6c5" (UID: "a2aaad27-2567-48ee-80c0-5c7e7f67f6c5"). InnerVolumeSpecName "kube-api-access-d9mvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:48:03.960286 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:03.960269    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a2aaad27-2567-48ee-80c0-5c7e7f67f6c5" (UID: "a2aaad27-2567-48ee-80c0-5c7e7f67f6c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:48:04.059174 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.059139    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9mvp\" (UniqueName: \"kubernetes.io/projected/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-kube-api-access-d9mvp\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:48:04.059174 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.059172    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:48:04.059393 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.059183    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46b765b7-bc8b-4a97-806e-36f6bd70d2cf-plugins-config-volume\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:48:04.059393 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.059192    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:48:04.059393 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.059200    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmqfg\" (UniqueName: \"kubernetes.io/projected/46b765b7-bc8b-4a97-806e-36f6bd70d2cf-kube-api-access-lmqfg\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:48:04.152611 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.152577    2582 generic.go:356] "Generic (PLEG): container finished" podID="46b765b7-bc8b-4a97-806e-36f6bd70d2cf" containerID="c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1" exitCode=0
Sep 16 14:48:04.152792 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.152622    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"
Sep 16 14:48:04.152792 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.152663    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7" event={"ID":"46b765b7-bc8b-4a97-806e-36f6bd70d2cf","Type":"ContainerDied","Data":"c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1"}
Sep 16 14:48:04.152792 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.152727    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7" event={"ID":"46b765b7-bc8b-4a97-806e-36f6bd70d2cf","Type":"ContainerDied","Data":"059ab416775c4318b74aa06794c1ef5f33809dcde9784f1fc793b7a176965f0c"}
Sep 16 14:48:04.152792 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.152757    2582 scope.go:117] "RemoveContainer" containerID="c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1"
Sep 16 14:48:04.154243 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.154208    2582 generic.go:356] "Generic (PLEG): container finished" podID="a2aaad27-2567-48ee-80c0-5c7e7f67f6c5" containerID="efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020" exitCode=0
Sep 16 14:48:04.154357 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.154261    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8" event={"ID":"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5","Type":"ContainerDied","Data":"efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020"}
Sep 16 14:48:04.154357 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.154286    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"
Sep 16 14:48:04.154357 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.154307    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8" event={"ID":"a2aaad27-2567-48ee-80c0-5c7e7f67f6c5","Type":"ContainerDied","Data":"8098b0782a64184dafae0709d0539529e79ab4689c39b014c3a0821a90cffe0f"}
Sep 16 14:48:04.162065 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.162047    2582 scope.go:117] "RemoveContainer" containerID="c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1"
Sep 16 14:48:04.162407 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:48:04.162381    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1\": container with ID starting with c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1 not found: ID does not exist" containerID="c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1"
Sep 16 14:48:04.162482 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.162420    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1"} err="failed to get container status \"c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1\": rpc error: code = NotFound desc = could not find container \"c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1\": container with ID starting with c169bd030f4153fdf69e2bfc7d24077207a8433b41fd508c8a1b9c5a42ad5fb1 not found: ID does not exist"
Sep 16 14:48:04.162482 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.162448    2582 scope.go:117] "RemoveContainer" containerID="efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020"
Sep 16 14:48:04.171306 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.171285    2582 scope.go:117] "RemoveContainer" containerID="efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020"
Sep 16 14:48:04.171590 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:48:04.171572    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020\": container with ID starting with efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020 not found: ID does not exist" containerID="efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020"
Sep 16 14:48:04.171642 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.171596    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020"} err="failed to get container status \"efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020\": rpc error: code = NotFound desc = could not find container \"efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020\": container with ID starting with efd07e8670ccfea297b6c7bbef9ee04ad481bf47363de4eae621a8006bb94020 not found: ID does not exist"
Sep 16 14:48:04.210193 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.210167    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"]
Sep 16 14:48:04.217705 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.217683    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a70ddb-5f48f7fbc-h2pc8"]
Sep 16 14:48:04.236317 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.236289    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:04.237997 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.237979    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"]
Sep 16 14:48:04.252266 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.248686    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7"]
Sep 16 14:48:04.304251 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:04.304200    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:05.179937 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:05.179897    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46b765b7-bc8b-4a97-806e-36f6bd70d2cf" path="/var/lib/kubelet/pods/46b765b7-bc8b-4a97-806e-36f6bd70d2cf/volumes"
Sep 16 14:48:05.180333 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:05.180319    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2aaad27-2567-48ee-80c0-5c7e7f67f6c5" path="/var/lib/kubelet/pods/a2aaad27-2567-48ee-80c0-5c7e7f67f6c5/volumes"
Sep 16 14:48:05.312231 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:05.312201    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:06.035191 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:06.035148    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:06.707911 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:06.707881    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:06.948195 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:06.948162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:07.039117 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:07.039089    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:09.257605 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:09.257574    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:15.515295 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:15.515262    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:48:45.964402 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:45.964370    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:46.102099 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:46.102065    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:51.874158 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:51.874119    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:53.854288 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:53.854223    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:53.954147 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:53.954107    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:54.510957 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:54.510926    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:55.409203 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:55.409173    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:48:56.068897 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:48:56.068869    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:03.181517 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.181486    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"]
Sep 16 14:49:03.182034 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.181694    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf" podUID="ea80e197-861d-4955-94d2-a815ac6bbea1" containerName="maas-api" containerID="cri-o://fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d" gracePeriod=30
Sep 16 14:49:03.204181 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.204152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:03.284661 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.284627    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:03.356213 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.356175    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:03.425134 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.425083    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:03.425319 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.425301    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:49:03.478927 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.478850    2582 generic.go:356] "Generic (PLEG): container finished" podID="ea80e197-861d-4955-94d2-a815ac6bbea1" containerID="fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d" exitCode=0
Sep 16 14:49:03.478927 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.478887    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"
Sep 16 14:49:03.478927 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.478906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf" event={"ID":"ea80e197-861d-4955-94d2-a815ac6bbea1","Type":"ContainerDied","Data":"fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d"}
Sep 16 14:49:03.479154 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.478964    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf" event={"ID":"ea80e197-861d-4955-94d2-a815ac6bbea1","Type":"ContainerDied","Data":"abf99a0997a460b17cc1d00dfaaf07afaf3ad5643dc9fbd97aa22d750c00022b"}
Sep 16 14:49:03.479154 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.478999    2582 scope.go:117] "RemoveContainer" containerID="fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d"
Sep 16 14:49:03.488107 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.488084    2582 scope.go:117] "RemoveContainer" containerID="fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d"
Sep 16 14:49:03.488398 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:49:03.488380    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d\": container with ID starting with fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d not found: ID does not exist" containerID="fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d"
Sep 16 14:49:03.488466 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.488410    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d"} err="failed to get container status \"fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d\": rpc error: code = NotFound desc = could not find container \"fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d\": container with ID starting with fb1ff8cc9de679699ed570253323e82a181832ce30518075686fbd657c0b4b5d not found: ID does not exist"
Sep 16 14:49:03.577516 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.577478    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea80e197-861d-4955-94d2-a815ac6bbea1-openshift-service-ca\") pod \"ea80e197-861d-4955-94d2-a815ac6bbea1\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") "
Sep 16 14:49:03.577679 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.577537    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-metrics-certs\") pod \"ea80e197-861d-4955-94d2-a815ac6bbea1\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") "
Sep 16 14:49:03.577679 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.577582    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-maas-api-tls\") pod \"ea80e197-861d-4955-94d2-a815ac6bbea1\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") "
Sep 16 14:49:03.577679 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.577663    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxfwv\" (UniqueName: \"kubernetes.io/projected/ea80e197-861d-4955-94d2-a815ac6bbea1-kube-api-access-cxfwv\") pod \"ea80e197-861d-4955-94d2-a815ac6bbea1\" (UID: \"ea80e197-861d-4955-94d2-a815ac6bbea1\") "
Sep 16 14:49:03.578339 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.578308    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea80e197-861d-4955-94d2-a815ac6bbea1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ea80e197-861d-4955-94d2-a815ac6bbea1" (UID: "ea80e197-861d-4955-94d2-a815ac6bbea1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:49:03.580173 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.580136    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ea80e197-861d-4955-94d2-a815ac6bbea1" (UID: "ea80e197-861d-4955-94d2-a815ac6bbea1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:49:03.580358 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.580185    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ea80e197-861d-4955-94d2-a815ac6bbea1" (UID: "ea80e197-861d-4955-94d2-a815ac6bbea1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:49:03.580358 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.580305    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea80e197-861d-4955-94d2-a815ac6bbea1-kube-api-access-cxfwv" (OuterVolumeSpecName: "kube-api-access-cxfwv") pod "ea80e197-861d-4955-94d2-a815ac6bbea1" (UID: "ea80e197-861d-4955-94d2-a815ac6bbea1"). InnerVolumeSpecName "kube-api-access-cxfwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:49:03.679113 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.679088    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea80e197-861d-4955-94d2-a815ac6bbea1-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:03.679113 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.679113    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:03.679113 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.679123    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea80e197-861d-4955-94d2-a815ac6bbea1-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:03.679332 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.679137    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxfwv\" (UniqueName: \"kubernetes.io/projected/ea80e197-861d-4955-94d2-a815ac6bbea1-kube-api-access-cxfwv\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:03.801187 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.801152    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"]
Sep 16 14:49:03.803833 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.803791    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:03.805243 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:03.805213    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3eaa3c-b7d8b7ccb-6zpzf"]
Sep 16 14:49:04.458907 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:04.458870    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:04.634092 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:04.634058    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:05.186462 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:05.186431    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea80e197-861d-4955-94d2-a815ac6bbea1" path="/var/lib/kubelet/pods/ea80e197-861d-4955-94d2-a815ac6bbea1/volumes"
Sep 16 14:49:05.345820 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:05.345784    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:06.014420 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:06.014379    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:06.533477 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:06.533440    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:49:11.858156 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:11.858116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:11.958839 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:11.958805    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:12.149058 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:12.148978    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:13.012606 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:13.012577    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:19.382248 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:19.382194    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:20.856577 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:20.856540    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:20.935764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:20.935716    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:21.001890 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:21.001857    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:21.069674 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:21.069643    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:21.447818 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:21.447776    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:21.550762 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:21.550732    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:22.325804 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:22.325770    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:23.910829 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:23.910792    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:49:27.572134 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:27.572094    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:27.646017 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:27.645986    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:28.101917 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:28.101879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:28.203430 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:28.203401    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:28.369369 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:28.369282    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"]
Sep 16 14:49:28.369568 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:28.369539    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerName="istio-proxy" containerID="cri-o://79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d" gracePeriod=30
Sep 16 14:49:28.398643 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:28.398615    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:28.993625 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:28.993591    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:30.029349 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:30.029314    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:31.175358 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:31.175317    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:33.614861 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.614837    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:49:33.652408 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.652339    2582 generic.go:356] "Generic (PLEG): container finished" podID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerID="79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d" exitCode=0
Sep 16 14:49:33.652408 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.652372    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" event={"ID":"6c45e664-8868-43fe-b0f3-2c5b058cc5a1","Type":"ContainerDied","Data":"79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d"}
Sep 16 14:49:33.652567 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.652416    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"
Sep 16 14:49:33.652567 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.652430    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4" event={"ID":"6c45e664-8868-43fe-b0f3-2c5b058cc5a1","Type":"ContainerDied","Data":"a3d928eb977fa9ab7aeeda4d220fb75b808f67e4854c2c3a4f5bebc3a2dcf917"}
Sep 16 14:49:33.652567 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.652455    2582 scope.go:117] "RemoveContainer" containerID="79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d"
Sep 16 14:49:33.661286 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.661270    2582 scope.go:117] "RemoveContainer" containerID="64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044"
Sep 16 14:49:33.669081 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.669065    2582 scope.go:117] "RemoveContainer" containerID="79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d"
Sep 16 14:49:33.669371 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:49:33.669354    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d\": container with ID starting with 79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d not found: ID does not exist" containerID="79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d"
Sep 16 14:49:33.669433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.669378    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d"} err="failed to get container status \"79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d\": rpc error: code = NotFound desc = could not find container \"79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d\": container with ID starting with 79bb1c23f5c13ca7e7d98f4d99318e4db634c8d388bb5284bef2b7261849504d not found: ID does not exist"
Sep 16 14:49:33.669433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.669392    2582 scope.go:117] "RemoveContainer" containerID="64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044"
Sep 16 14:49:33.669632 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:49:33.669617    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044\": container with ID starting with 64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044 not found: ID does not exist" containerID="64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044"
Sep 16 14:49:33.669674 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.669637    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044"} err="failed to get container status \"64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044\": rpc error: code = NotFound desc = could not find container \"64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044\": container with ID starting with 64ec25a59dbc6974eb84d9bd55a220173a953d03b5bd112839c53ec86c170044 not found: ID does not exist"
Sep 16 14:49:33.724811 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.724785    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-workload-certs\") pod \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") "
Sep 16 14:49:33.724915 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.724864    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-data\") pod \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") "
Sep 16 14:49:33.724979 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.724913    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-credential-socket\") pod \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") "
Sep 16 14:49:33.724979 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.724940    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-token\") pod \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") "
Sep 16 14:49:33.724979 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.724967    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istiod-ca-cert\") pod \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") "
Sep 16 14:49:33.725143 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.724992    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-workload-socket\") pod \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") "
Sep 16 14:49:33.725143 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725019    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c45e664-8868-43fe-b0f3-2c5b058cc5a1" (UID: "6c45e664-8868-43fe-b0f3-2c5b058cc5a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:49:33.725143 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725028    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-podinfo\") pod \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") "
Sep 16 14:49:33.725143 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725088    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-envoy\") pod \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") "
Sep 16 14:49:33.725143 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725129    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c45e664-8868-43fe-b0f3-2c5b058cc5a1" (UID: "6c45e664-8868-43fe-b0f3-2c5b058cc5a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:49:33.725433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725137    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjw4v\" (UniqueName: \"kubernetes.io/projected/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-kube-api-access-wjw4v\") pod \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\" (UID: \"6c45e664-8868-43fe-b0f3-2c5b058cc5a1\") "
Sep 16 14:49:33.725433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725177    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c45e664-8868-43fe-b0f3-2c5b058cc5a1" (UID: "6c45e664-8868-43fe-b0f3-2c5b058cc5a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:49:33.725433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725357    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c45e664-8868-43fe-b0f3-2c5b058cc5a1" (UID: "6c45e664-8868-43fe-b0f3-2c5b058cc5a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:49:33.725433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725383    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c45e664-8868-43fe-b0f3-2c5b058cc5a1" (UID: "6c45e664-8868-43fe-b0f3-2c5b058cc5a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:49:33.725660 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725543    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-workload-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:33.725660 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725563    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-data\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:33.725660 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725578    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-credential-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:33.725660 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725592    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istiod-ca-cert\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:33.725660 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.725607    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-workload-socket\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:33.727227 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.727200    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-kube-api-access-wjw4v" (OuterVolumeSpecName: "kube-api-access-wjw4v") pod "6c45e664-8868-43fe-b0f3-2c5b058cc5a1" (UID: "6c45e664-8868-43fe-b0f3-2c5b058cc5a1"). InnerVolumeSpecName "kube-api-access-wjw4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:49:33.727227 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.727196    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c45e664-8868-43fe-b0f3-2c5b058cc5a1" (UID: "6c45e664-8868-43fe-b0f3-2c5b058cc5a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:49:33.727385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.727227    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c45e664-8868-43fe-b0f3-2c5b058cc5a1" (UID: "6c45e664-8868-43fe-b0f3-2c5b058cc5a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:49:33.727385 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.727225    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c45e664-8868-43fe-b0f3-2c5b058cc5a1" (UID: "6c45e664-8868-43fe-b0f3-2c5b058cc5a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:49:33.826955 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.826932    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-token\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:33.826955 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.826954    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-podinfo\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:33.827088 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.826963    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-istio-envoy\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:33.827088 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.826972    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjw4v\" (UniqueName: \"kubernetes.io/projected/6c45e664-8868-43fe-b0f3-2c5b058cc5a1-kube-api-access-wjw4v\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:33.976608 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.976580    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"]
Sep 16 14:49:33.980885 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:33.980862    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4"]
Sep 16 14:49:35.180223 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:35.180189    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" path="/var/lib/kubelet/pods/6c45e664-8868-43fe-b0f3-2c5b058cc5a1/volumes"
Sep 16 14:49:39.219462 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.219430    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"]
Sep 16 14:49:39.219890 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.219625    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl" podUID="2b7293cf-538e-43a9-b5db-dce81622ecb4" containerName="maas-api" containerID="cri-o://2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9" gracePeriod=30
Sep 16 14:49:39.231440 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.231408    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:39.275163 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.275138    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"]
Sep 16 14:49:39.275358 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.275338    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6" podUID="99e199df-ccb8-4225-8b9c-7afde24060ec" containerName="payload-pre-processing" containerID="cri-o://fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0" gracePeriod=30
Sep 16 14:49:39.335062 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.335013    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:39.446882 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.446678    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:39.514548 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.514519    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:39.520008 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.519989    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:49:39.548391 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.548365    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"
Sep 16 14:49:39.574434 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.574406    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b7293cf-538e-43a9-b5db-dce81622ecb4-maas-api-tls\") pod \"2b7293cf-538e-43a9-b5db-dce81622ecb4\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") "
Sep 16 14:49:39.574604 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.574439    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfmwz\" (UniqueName: \"kubernetes.io/projected/99e199df-ccb8-4225-8b9c-7afde24060ec-kube-api-access-xfmwz\") pod \"99e199df-ccb8-4225-8b9c-7afde24060ec\" (UID: \"99e199df-ccb8-4225-8b9c-7afde24060ec\") "
Sep 16 14:49:39.574604 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.574457    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcqxg\" (UniqueName: \"kubernetes.io/projected/2b7293cf-538e-43a9-b5db-dce81622ecb4-kube-api-access-fcqxg\") pod \"2b7293cf-538e-43a9-b5db-dce81622ecb4\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") "
Sep 16 14:49:39.574604 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.574501    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7293cf-538e-43a9-b5db-dce81622ecb4-openshift-service-ca\") pod \"2b7293cf-538e-43a9-b5db-dce81622ecb4\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") "
Sep 16 14:49:39.574604 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.574529    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99e199df-ccb8-4225-8b9c-7afde24060ec-plugins-config-volume\") pod \"99e199df-ccb8-4225-8b9c-7afde24060ec\" (UID: \"99e199df-ccb8-4225-8b9c-7afde24060ec\") "
Sep 16 14:49:39.574604 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.574562    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b7293cf-538e-43a9-b5db-dce81622ecb4-metrics-certs\") pod \"2b7293cf-538e-43a9-b5db-dce81622ecb4\" (UID: \"2b7293cf-538e-43a9-b5db-dce81622ecb4\") "
Sep 16 14:49:39.574986 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.574959    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99e199df-ccb8-4225-8b9c-7afde24060ec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "99e199df-ccb8-4225-8b9c-7afde24060ec" (UID: "99e199df-ccb8-4225-8b9c-7afde24060ec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:49:39.574986 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.574972    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b7293cf-538e-43a9-b5db-dce81622ecb4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b7293cf-538e-43a9-b5db-dce81622ecb4" (UID: "2b7293cf-538e-43a9-b5db-dce81622ecb4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:49:39.577423 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.577394    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b7293cf-538e-43a9-b5db-dce81622ecb4-kube-api-access-fcqxg" (OuterVolumeSpecName: "kube-api-access-fcqxg") pod "2b7293cf-538e-43a9-b5db-dce81622ecb4" (UID: "2b7293cf-538e-43a9-b5db-dce81622ecb4"). InnerVolumeSpecName "kube-api-access-fcqxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:49:39.577534 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.577452    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99e199df-ccb8-4225-8b9c-7afde24060ec-kube-api-access-xfmwz" (OuterVolumeSpecName: "kube-api-access-xfmwz") pod "99e199df-ccb8-4225-8b9c-7afde24060ec" (UID: "99e199df-ccb8-4225-8b9c-7afde24060ec"). InnerVolumeSpecName "kube-api-access-xfmwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:49:39.577815 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.577780    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7293cf-538e-43a9-b5db-dce81622ecb4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b7293cf-538e-43a9-b5db-dce81622ecb4" (UID: "2b7293cf-538e-43a9-b5db-dce81622ecb4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:49:39.577910 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.577855    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7293cf-538e-43a9-b5db-dce81622ecb4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2b7293cf-538e-43a9-b5db-dce81622ecb4" (UID: "2b7293cf-538e-43a9-b5db-dce81622ecb4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:49:39.675832 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.675804    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b7293cf-538e-43a9-b5db-dce81622ecb4-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:39.675832 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.675828    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfmwz\" (UniqueName: \"kubernetes.io/projected/99e199df-ccb8-4225-8b9c-7afde24060ec-kube-api-access-xfmwz\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:39.675832 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.675838    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcqxg\" (UniqueName: \"kubernetes.io/projected/2b7293cf-538e-43a9-b5db-dce81622ecb4-kube-api-access-fcqxg\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:39.676038 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.675847    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7293cf-538e-43a9-b5db-dce81622ecb4-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:39.676038 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.675856    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99e199df-ccb8-4225-8b9c-7afde24060ec-plugins-config-volume\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:39.676038 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.675864    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b7293cf-538e-43a9-b5db-dce81622ecb4-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:49:39.683543 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.683518    2582 generic.go:356] "Generic (PLEG): container finished" podID="99e199df-ccb8-4225-8b9c-7afde24060ec" containerID="fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0" exitCode=0
Sep 16 14:49:39.683666 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.683566    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"
Sep 16 14:49:39.683666 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.683604    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6" event={"ID":"99e199df-ccb8-4225-8b9c-7afde24060ec","Type":"ContainerDied","Data":"fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0"}
Sep 16 14:49:39.683789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.683670    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6" event={"ID":"99e199df-ccb8-4225-8b9c-7afde24060ec","Type":"ContainerDied","Data":"69d7bf2ab4f580715bc91cba6ca101459b01f596a21a68f82c5b9ec2a4a50ee7"}
Sep 16 14:49:39.683789 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.683703    2582 scope.go:117] "RemoveContainer" containerID="fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0"
Sep 16 14:49:39.685029 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.685005    2582 generic.go:356] "Generic (PLEG): container finished" podID="2b7293cf-538e-43a9-b5db-dce81622ecb4" containerID="2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9" exitCode=0
Sep 16 14:49:39.685094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.685048    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"
Sep 16 14:49:39.685094 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.685058    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl" event={"ID":"2b7293cf-538e-43a9-b5db-dce81622ecb4","Type":"ContainerDied","Data":"2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9"}
Sep 16 14:49:39.685181 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.685097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl" event={"ID":"2b7293cf-538e-43a9-b5db-dce81622ecb4","Type":"ContainerDied","Data":"05ae9d41eabed5c98ba21d39a453cb077f0b77e11899a03b877465526ac88c34"}
Sep 16 14:49:39.692813 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.692798    2582 scope.go:117] "RemoveContainer" containerID="fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0"
Sep 16 14:49:39.693107 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:49:39.693079    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0\": container with ID starting with fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0 not found: ID does not exist" containerID="fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0"
Sep 16 14:49:39.693174 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.693112    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0"} err="failed to get container status \"fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0\": rpc error: code = NotFound desc = could not find container \"fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0\": container with ID starting with fa8fe541ef5675d6f6d85ccf96cc08acca4f3cb82dcf116f21a0c40e600546d0 not found: ID does not exist"
Sep 16 14:49:39.693174 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.693134    2582 scope.go:117] "RemoveContainer" containerID="2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9"
Sep 16 14:49:39.701889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.701869    2582 scope.go:117] "RemoveContainer" containerID="2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9"
Sep 16 14:49:39.702160 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:49:39.702143    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9\": container with ID starting with 2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9 not found: ID does not exist" containerID="2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9"
Sep 16 14:49:39.702216 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.702166    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9"} err="failed to get container status \"2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9\": rpc error: code = NotFound desc = could not find container \"2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9\": container with ID starting with 2f9bf939654c4a28ddc7dc51d8754507403ab37cbc4a883bd1c8a3bf3cc2aaa9 not found: ID does not exist"
Sep 16 14:49:39.709844 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.709820    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"]
Sep 16 14:49:39.715134 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.715103    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-055ce3-78975f4754-hddkl"]
Sep 16 14:49:39.726198 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.726152    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"]
Sep 16 14:49:39.730357 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.730337    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6"]
Sep 16 14:49:39.907585 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:39.907557    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:40.018171 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:40.018100    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:41.180120 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:41.180087    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b7293cf-538e-43a9-b5db-dce81622ecb4" path="/var/lib/kubelet/pods/2b7293cf-538e-43a9-b5db-dce81622ecb4/volumes"
Sep 16 14:49:41.180483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:41.180460    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99e199df-ccb8-4225-8b9c-7afde24060ec" path="/var/lib/kubelet/pods/99e199df-ccb8-4225-8b9c-7afde24060ec/volumes"
Sep 16 14:49:42.119152 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:42.119113    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:49:46.133777 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:46.133745    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:46.235407 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:46.235375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:46.404904 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:46.404827    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:51.225856 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:49:51.225816    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:50:51.808892 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.808813    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d46d94b58-jzh6x"]
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809194    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99e199df-ccb8-4225-8b9c-7afde24060ec" containerName="payload-pre-processing"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809219    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="99e199df-ccb8-4225-8b9c-7afde24060ec" containerName="payload-pre-processing"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809246    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7293cf-538e-43a9-b5db-dce81622ecb4" containerName="maas-api"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809255    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7293cf-538e-43a9-b5db-dce81622ecb4" containerName="maas-api"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809265    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2aaad27-2567-48ee-80c0-5c7e7f67f6c5" containerName="maas-api"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809273    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2aaad27-2567-48ee-80c0-5c7e7f67f6c5" containerName="maas-api"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809288    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e38e40-32d3-402a-97d3-439507889b56" containerName="payload-pre-processing"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809296    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e38e40-32d3-402a-97d3-439507889b56" containerName="payload-pre-processing"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809304    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerName="istio-proxy"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809310    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerName="istio-proxy"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809319    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerName="istio-proxy"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809324    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerName="istio-proxy"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809329    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d047b611-ebfd-442e-8ef6-9e4e0e351a0e" containerName="payload-processing"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809335    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d047b611-ebfd-442e-8ef6-9e4e0e351a0e" containerName="payload-processing"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809347    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea80e197-861d-4955-94d2-a815ac6bbea1" containerName="maas-api"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809351    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea80e197-861d-4955-94d2-a815ac6bbea1" containerName="maas-api"
Sep 16 14:50:51.809351 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809359    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b765b7-bc8b-4a97-806e-36f6bd70d2cf" containerName="payload-pre-processing"
Sep 16 14:50:51.809873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809364    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b765b7-bc8b-4a97-806e-36f6bd70d2cf" containerName="payload-pre-processing"
Sep 16 14:50:51.809873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809423    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="46b765b7-bc8b-4a97-806e-36f6bd70d2cf" containerName="payload-pre-processing"
Sep 16 14:50:51.809873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809432    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerName="istio-proxy"
Sep 16 14:50:51.809873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809439    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="99e199df-ccb8-4225-8b9c-7afde24060ec" containerName="payload-pre-processing"
Sep 16 14:50:51.809873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809445    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9e38e40-32d3-402a-97d3-439507889b56" containerName="payload-pre-processing"
Sep 16 14:50:51.809873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809451    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d047b611-ebfd-442e-8ef6-9e4e0e351a0e" containerName="payload-processing"
Sep 16 14:50:51.809873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809456    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2aaad27-2567-48ee-80c0-5c7e7f67f6c5" containerName="maas-api"
Sep 16 14:50:51.809873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809461    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b7293cf-538e-43a9-b5db-dce81622ecb4" containerName="maas-api"
Sep 16 14:50:51.809873 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.809466    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea80e197-861d-4955-94d2-a815ac6bbea1" containerName="maas-api"
Sep 16 14:50:51.812360 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.812345    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:50:51.815975 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.815951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 14:50:51.816131 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.816111    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 14:50:51.816211 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.816194    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s8vl9\""
Sep 16 14:50:51.816211 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.816206    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 14:50:51.826326 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.826303    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d46d94b58-jzh6x"]
Sep 16 14:50:51.864667 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.864644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/330389f7-d74a-4155-97b8-e66d978264f3-webhook-cert\") pod \"maas-controller-6d46d94b58-jzh6x\" (UID: \"330389f7-d74a-4155-97b8-e66d978264f3\") " pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:50:51.864796 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.864680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkhkx\" (UniqueName: \"kubernetes.io/projected/330389f7-d74a-4155-97b8-e66d978264f3-kube-api-access-fkhkx\") pod \"maas-controller-6d46d94b58-jzh6x\" (UID: \"330389f7-d74a-4155-97b8-e66d978264f3\") " pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:50:51.864843 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.864790    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330389f7-d74a-4155-97b8-e66d978264f3-metrics-certs\") pod \"maas-controller-6d46d94b58-jzh6x\" (UID: \"330389f7-d74a-4155-97b8-e66d978264f3\") " pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:50:51.965316 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.965292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkhkx\" (UniqueName: \"kubernetes.io/projected/330389f7-d74a-4155-97b8-e66d978264f3-kube-api-access-fkhkx\") pod \"maas-controller-6d46d94b58-jzh6x\" (UID: \"330389f7-d74a-4155-97b8-e66d978264f3\") " pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:50:51.965450 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.965387    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330389f7-d74a-4155-97b8-e66d978264f3-metrics-certs\") pod \"maas-controller-6d46d94b58-jzh6x\" (UID: \"330389f7-d74a-4155-97b8-e66d978264f3\") " pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:50:51.965450 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.965410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/330389f7-d74a-4155-97b8-e66d978264f3-webhook-cert\") pod \"maas-controller-6d46d94b58-jzh6x\" (UID: \"330389f7-d74a-4155-97b8-e66d978264f3\") " pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:50:51.967934 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.967909    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/330389f7-d74a-4155-97b8-e66d978264f3-webhook-cert\") pod \"maas-controller-6d46d94b58-jzh6x\" (UID: \"330389f7-d74a-4155-97b8-e66d978264f3\") " pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:50:51.968029 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.967997    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330389f7-d74a-4155-97b8-e66d978264f3-metrics-certs\") pod \"maas-controller-6d46d94b58-jzh6x\" (UID: \"330389f7-d74a-4155-97b8-e66d978264f3\") " pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:50:51.974452 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:51.974432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkhkx\" (UniqueName: \"kubernetes.io/projected/330389f7-d74a-4155-97b8-e66d978264f3-kube-api-access-fkhkx\") pod \"maas-controller-6d46d94b58-jzh6x\" (UID: \"330389f7-d74a-4155-97b8-e66d978264f3\") " pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:50:52.127998 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:52.127903    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:50:52.401361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:52.401337    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d46d94b58-jzh6x"]
Sep 16 14:50:52.402631 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:50:52.402597    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330389f7_d74a_4155_97b8_e66d978264f3.slice/crio-de28a56650e8d224951bf3fad1f62afe6fa77ef8e1c868ee382dd10fca136ba5 WatchSource:0}: Error finding container de28a56650e8d224951bf3fad1f62afe6fa77ef8e1c868ee382dd10fca136ba5: Status 404 returned error can't find the container with id de28a56650e8d224951bf3fad1f62afe6fa77ef8e1c868ee382dd10fca136ba5
Sep 16 14:50:52.404095 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:52.404072    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:50:53.065039 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:53.065002    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d46d94b58-jzh6x" event={"ID":"330389f7-d74a-4155-97b8-e66d978264f3","Type":"ContainerStarted","Data":"de28a56650e8d224951bf3fad1f62afe6fa77ef8e1c868ee382dd10fca136ba5"}
Sep 16 14:50:54.072189 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:54.072154    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d46d94b58-jzh6x" event={"ID":"330389f7-d74a-4155-97b8-e66d978264f3","Type":"ContainerStarted","Data":"91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562"}
Sep 16 14:50:54.072586 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:54.072216    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:50:54.093214 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:50:54.093164    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d46d94b58-jzh6x" podStartSLOduration=2.427559025 podStartE2EDuration="3.093146828s" totalImagesPullingTime="665.587803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:50:54.090769334 +0000 UTC m=+2173.384457815" watchObservedRunningTime="2026-09-16 14:50:54.093146828 +0000 UTC m=+2173.386835307"
Sep 16 14:51:05.080444 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:05.080410    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:51:12.222601 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.222561    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:12.320643 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.320606    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d46d94b58-jzh6x"]
Sep 16 14:51:12.320942 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.320885    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6d46d94b58-jzh6x" podUID="330389f7-d74a-4155-97b8-e66d978264f3" containerName="manager" containerID="cri-o://91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562" gracePeriod=30
Sep 16 14:51:12.419761 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.419727    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:51:12.559382 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.559360    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:51:12.651080 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.651043    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330389f7-d74a-4155-97b8-e66d978264f3-metrics-certs\") pod \"330389f7-d74a-4155-97b8-e66d978264f3\" (UID: \"330389f7-d74a-4155-97b8-e66d978264f3\") "
Sep 16 14:51:12.651260 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.651100    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/330389f7-d74a-4155-97b8-e66d978264f3-webhook-cert\") pod \"330389f7-d74a-4155-97b8-e66d978264f3\" (UID: \"330389f7-d74a-4155-97b8-e66d978264f3\") "
Sep 16 14:51:12.651260 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.651137    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkhkx\" (UniqueName: \"kubernetes.io/projected/330389f7-d74a-4155-97b8-e66d978264f3-kube-api-access-fkhkx\") pod \"330389f7-d74a-4155-97b8-e66d978264f3\" (UID: \"330389f7-d74a-4155-97b8-e66d978264f3\") "
Sep 16 14:51:12.653425 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.653386    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/330389f7-d74a-4155-97b8-e66d978264f3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "330389f7-d74a-4155-97b8-e66d978264f3" (UID: "330389f7-d74a-4155-97b8-e66d978264f3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:51:12.653425 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.653406    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/330389f7-d74a-4155-97b8-e66d978264f3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "330389f7-d74a-4155-97b8-e66d978264f3" (UID: "330389f7-d74a-4155-97b8-e66d978264f3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:51:12.653425 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.653386    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/330389f7-d74a-4155-97b8-e66d978264f3-kube-api-access-fkhkx" (OuterVolumeSpecName: "kube-api-access-fkhkx") pod "330389f7-d74a-4155-97b8-e66d978264f3" (UID: "330389f7-d74a-4155-97b8-e66d978264f3"). InnerVolumeSpecName "kube-api-access-fkhkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:51:12.752032 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.751964    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkhkx\" (UniqueName: \"kubernetes.io/projected/330389f7-d74a-4155-97b8-e66d978264f3-kube-api-access-fkhkx\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:51:12.752032 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.751989    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330389f7-d74a-4155-97b8-e66d978264f3-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:51:12.752032 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:12.752000    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/330389f7-d74a-4155-97b8-e66d978264f3-webhook-cert\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:51:13.183199 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.183160    2582 generic.go:356] "Generic (PLEG): container finished" podID="330389f7-d74a-4155-97b8-e66d978264f3" containerID="91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562" exitCode=0
Sep 16 14:51:13.183399 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.183207    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d46d94b58-jzh6x"
Sep 16 14:51:13.183399 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.183275    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d46d94b58-jzh6x" event={"ID":"330389f7-d74a-4155-97b8-e66d978264f3","Type":"ContainerDied","Data":"91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562"}
Sep 16 14:51:13.183399 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.183345    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d46d94b58-jzh6x" event={"ID":"330389f7-d74a-4155-97b8-e66d978264f3","Type":"ContainerDied","Data":"de28a56650e8d224951bf3fad1f62afe6fa77ef8e1c868ee382dd10fca136ba5"}
Sep 16 14:51:13.183399 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.183394    2582 scope.go:117] "RemoveContainer" containerID="91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562"
Sep 16 14:51:13.195540 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.195518    2582 scope.go:117] "RemoveContainer" containerID="91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562"
Sep 16 14:51:13.195887 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:51:13.195854    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562\": container with ID starting with 91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562 not found: ID does not exist" containerID="91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562"
Sep 16 14:51:13.195982 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.195898    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562"} err="failed to get container status \"91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562\": rpc error: code = NotFound desc = could not find container \"91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562\": container with ID starting with 91751863f98c54db03ee33cc058c93148ab56ec65fbefcff8385cc1e89d72562 not found: ID does not exist"
Sep 16 14:51:13.211990 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.211965    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d46d94b58-jzh6x"]
Sep 16 14:51:13.215802 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.215770    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d46d94b58-jzh6x"]
Sep 16 14:51:13.996889 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.996855    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d46d94b58-5lqfb"]
Sep 16 14:51:13.997276 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.997207    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="330389f7-d74a-4155-97b8-e66d978264f3" containerName="manager"
Sep 16 14:51:13.997276 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.997218    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="330389f7-d74a-4155-97b8-e66d978264f3" containerName="manager"
Sep 16 14:51:13.997361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.997303    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="330389f7-d74a-4155-97b8-e66d978264f3" containerName="manager"
Sep 16 14:51:13.997361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:13.997315    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c45e664-8868-43fe-b0f3-2c5b058cc5a1" containerName="istio-proxy"
Sep 16 14:51:14.001562 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.001546    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:14.004965 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.004944    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 14:51:14.005206 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.005173    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s8vl9\""
Sep 16 14:51:14.005206 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.005195    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 14:51:14.005405 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.005263    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 14:51:14.012624 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.012604    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d46d94b58-5lqfb"]
Sep 16 14:51:14.166079 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.166050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b93ac95e-353b-4faa-b97c-d56d77b2db3d-webhook-cert\") pod \"maas-controller-6d46d94b58-5lqfb\" (UID: \"b93ac95e-353b-4faa-b97c-d56d77b2db3d\") " pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:14.166303 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.166084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b93ac95e-353b-4faa-b97c-d56d77b2db3d-metrics-certs\") pod \"maas-controller-6d46d94b58-5lqfb\" (UID: \"b93ac95e-353b-4faa-b97c-d56d77b2db3d\") " pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:14.166303 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.166214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqg7x\" (UniqueName: \"kubernetes.io/projected/b93ac95e-353b-4faa-b97c-d56d77b2db3d-kube-api-access-zqg7x\") pod \"maas-controller-6d46d94b58-5lqfb\" (UID: \"b93ac95e-353b-4faa-b97c-d56d77b2db3d\") " pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:14.267392 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.267315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b93ac95e-353b-4faa-b97c-d56d77b2db3d-webhook-cert\") pod \"maas-controller-6d46d94b58-5lqfb\" (UID: \"b93ac95e-353b-4faa-b97c-d56d77b2db3d\") " pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:14.267392 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.267343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b93ac95e-353b-4faa-b97c-d56d77b2db3d-metrics-certs\") pod \"maas-controller-6d46d94b58-5lqfb\" (UID: \"b93ac95e-353b-4faa-b97c-d56d77b2db3d\") " pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:14.267601 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.267409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqg7x\" (UniqueName: \"kubernetes.io/projected/b93ac95e-353b-4faa-b97c-d56d77b2db3d-kube-api-access-zqg7x\") pod \"maas-controller-6d46d94b58-5lqfb\" (UID: \"b93ac95e-353b-4faa-b97c-d56d77b2db3d\") " pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:14.269851 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.269826    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b93ac95e-353b-4faa-b97c-d56d77b2db3d-metrics-certs\") pod \"maas-controller-6d46d94b58-5lqfb\" (UID: \"b93ac95e-353b-4faa-b97c-d56d77b2db3d\") " pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:14.269950 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.269884    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b93ac95e-353b-4faa-b97c-d56d77b2db3d-webhook-cert\") pod \"maas-controller-6d46d94b58-5lqfb\" (UID: \"b93ac95e-353b-4faa-b97c-d56d77b2db3d\") " pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:14.275939 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.275917    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqg7x\" (UniqueName: \"kubernetes.io/projected/b93ac95e-353b-4faa-b97c-d56d77b2db3d-kube-api-access-zqg7x\") pod \"maas-controller-6d46d94b58-5lqfb\" (UID: \"b93ac95e-353b-4faa-b97c-d56d77b2db3d\") " pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:14.312382 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.312357    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:14.589164 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:14.589135    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d46d94b58-5lqfb"]
Sep 16 14:51:14.591841 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:51:14.591811    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb93ac95e_353b_4faa_b97c_d56d77b2db3d.slice/crio-84f3effb3f0e1324eac7154338509ef08f51e8be22effe296f8e801c697686c5 WatchSource:0}: Error finding container 84f3effb3f0e1324eac7154338509ef08f51e8be22effe296f8e801c697686c5: Status 404 returned error can't find the container with id 84f3effb3f0e1324eac7154338509ef08f51e8be22effe296f8e801c697686c5
Sep 16 14:51:15.179419 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:15.179381    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="330389f7-d74a-4155-97b8-e66d978264f3" path="/var/lib/kubelet/pods/330389f7-d74a-4155-97b8-e66d978264f3/volumes"
Sep 16 14:51:15.198596 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:15.198565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d46d94b58-5lqfb" event={"ID":"b93ac95e-353b-4faa-b97c-d56d77b2db3d","Type":"ContainerStarted","Data":"84f3effb3f0e1324eac7154338509ef08f51e8be22effe296f8e801c697686c5"}
Sep 16 14:51:16.247805 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:16.247760    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:18.215824 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:18.215776    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d46d94b58-5lqfb" event={"ID":"b93ac95e-353b-4faa-b97c-d56d77b2db3d","Type":"ContainerStarted","Data":"4b3b0efabec46081d62ba4d1473e4caf3aa3cafa701a7a982797083c58b09cdd"}
Sep 16 14:51:18.216199 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:18.215852    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:18.236759 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:18.236706    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d46d94b58-5lqfb" podStartSLOduration=2.396264571 podStartE2EDuration="5.236690413s" totalImagesPullingTime="2.840425842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:51:18.236117538 +0000 UTC m=+2197.529806018" watchObservedRunningTime="2026-09-16 14:51:18.236690413 +0000 UTC m=+2197.530378892"
Sep 16 14:51:29.223070 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:29.223038    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d46d94b58-5lqfb"
Sep 16 14:51:41.217678 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:41.217644    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:51:49.013944 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:49.013907    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:51:58.026997 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:51:58.026962    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:52:15.514667 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:52:15.514632    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:52:22.318823 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:52:22.318788    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:53:21.179400 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:53:21.179362    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:48.621442 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:53:48.621367    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:53:56.346844 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:53:56.346808    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:54:06.967255 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:54:06.967184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:09.418191 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:54:09.418146    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:54:16.351555 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:54:16.351512    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:17.730480 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:54:17.730443    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:20.625743 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:54:20.625709    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:54:52.340306 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:54:52.340265    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:53.049606 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:54:53.049575    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:54.633273 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:54:54.633228    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:55:02.028142 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.028106    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"]
Sep 16 14:55:02.031549 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.031529    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.045289 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.045230    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"]
Sep 16 14:55:02.134151 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.134109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493227f8-6817-45d6-b58e-ba879a8f347e-openshift-service-ca\") pod \"maas-api-6976c56b87-j46wx\" (UID: \"493227f8-6817-45d6-b58e-ba879a8f347e\") " pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.134361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.134162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493227f8-6817-45d6-b58e-ba879a8f347e-maas-api-tls\") pod \"maas-api-6976c56b87-j46wx\" (UID: \"493227f8-6817-45d6-b58e-ba879a8f347e\") " pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.134361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.134306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svhnc\" (UniqueName: \"kubernetes.io/projected/493227f8-6817-45d6-b58e-ba879a8f347e-kube-api-access-svhnc\") pod \"maas-api-6976c56b87-j46wx\" (UID: \"493227f8-6817-45d6-b58e-ba879a8f347e\") " pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.134361 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.134343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/493227f8-6817-45d6-b58e-ba879a8f347e-metrics-certs\") pod \"maas-api-6976c56b87-j46wx\" (UID: \"493227f8-6817-45d6-b58e-ba879a8f347e\") " pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.235391 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.235354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svhnc\" (UniqueName: \"kubernetes.io/projected/493227f8-6817-45d6-b58e-ba879a8f347e-kube-api-access-svhnc\") pod \"maas-api-6976c56b87-j46wx\" (UID: \"493227f8-6817-45d6-b58e-ba879a8f347e\") " pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.235391 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.235394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/493227f8-6817-45d6-b58e-ba879a8f347e-metrics-certs\") pod \"maas-api-6976c56b87-j46wx\" (UID: \"493227f8-6817-45d6-b58e-ba879a8f347e\") " pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.235638 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.235455    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493227f8-6817-45d6-b58e-ba879a8f347e-openshift-service-ca\") pod \"maas-api-6976c56b87-j46wx\" (UID: \"493227f8-6817-45d6-b58e-ba879a8f347e\") " pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.235638 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.235494    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493227f8-6817-45d6-b58e-ba879a8f347e-maas-api-tls\") pod \"maas-api-6976c56b87-j46wx\" (UID: \"493227f8-6817-45d6-b58e-ba879a8f347e\") " pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.236174 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.236147    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493227f8-6817-45d6-b58e-ba879a8f347e-openshift-service-ca\") pod \"maas-api-6976c56b87-j46wx\" (UID: \"493227f8-6817-45d6-b58e-ba879a8f347e\") " pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.237901 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.237876    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493227f8-6817-45d6-b58e-ba879a8f347e-maas-api-tls\") pod \"maas-api-6976c56b87-j46wx\" (UID: \"493227f8-6817-45d6-b58e-ba879a8f347e\") " pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.238001 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.237925    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/493227f8-6817-45d6-b58e-ba879a8f347e-metrics-certs\") pod \"maas-api-6976c56b87-j46wx\" (UID: \"493227f8-6817-45d6-b58e-ba879a8f347e\") " pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.243464 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.243441    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svhnc\" (UniqueName: \"kubernetes.io/projected/493227f8-6817-45d6-b58e-ba879a8f347e-kube-api-access-svhnc\") pod \"maas-api-6976c56b87-j46wx\" (UID: \"493227f8-6817-45d6-b58e-ba879a8f347e\") " pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.345371 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.345336    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:02.425498 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.425468    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:55:02.624850 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:02.624824    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"]
Sep 16 14:55:02.627276 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:55:02.627229    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493227f8_6817_45d6_b58e_ba879a8f347e.slice/crio-6422ad60bd7e1392dec4a4c01ff9c4ef14ee964ad368320d5db6945c27110870 WatchSource:0}: Error finding container 6422ad60bd7e1392dec4a4c01ff9c4ef14ee964ad368320d5db6945c27110870: Status 404 returned error can't find the container with id 6422ad60bd7e1392dec4a4c01ff9c4ef14ee964ad368320d5db6945c27110870
Sep 16 14:55:03.407536 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:03.407498    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx" event={"ID":"493227f8-6817-45d6-b58e-ba879a8f347e","Type":"ContainerStarted","Data":"6422ad60bd7e1392dec4a4c01ff9c4ef14ee964ad368320d5db6945c27110870"}
Sep 16 14:55:04.413772 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:04.413734    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx" event={"ID":"493227f8-6817-45d6-b58e-ba879a8f347e","Type":"ContainerStarted","Data":"9c82c1600ae0ee56b883b60c9e190ea64cee149f1cd48ff76ec7ae6b328ffc22"}
Sep 16 14:55:04.414291 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:04.413795    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:04.441542 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:04.441493    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx" podStartSLOduration=1.477576971 podStartE2EDuration="2.441477817s" totalImagesPullingTime="963.900846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:55:04.440007771 +0000 UTC m=+2423.733696251" watchObservedRunningTime="2026-09-16 14:55:04.441477817 +0000 UTC m=+2423.735166336"
Sep 16 14:55:10.251413 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:10.251376    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:55:10.424551 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:10.424515    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6976c56b87-j46wx"
Sep 16 14:55:10.568354 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:10.568322    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"]
Sep 16 14:55:10.568546 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:10.568525    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8" podUID="ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a" containerName="maas-api" containerID="cri-o://fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52" gracePeriod=30
Sep 16 14:55:11.814552 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:11.814525    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:55:11.914277 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:11.914187    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khf9n\" (UniqueName: \"kubernetes.io/projected/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-kube-api-access-khf9n\") pod \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") "
Sep 16 14:55:11.914277 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:11.914226    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-openshift-service-ca\") pod \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") "
Sep 16 14:55:11.914495 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:11.914279    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-maas-api-tls\") pod \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") "
Sep 16 14:55:11.914495 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:11.914343    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-metrics-certs\") pod \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\" (UID: \"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a\") "
Sep 16 14:55:11.914651 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:11.914629    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a" (UID: "ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:55:11.914760 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:11.914736    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-openshift-service-ca\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:55:11.916527 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:11.916503    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a" (UID: "ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:55:11.916635 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:11.916526    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-kube-api-access-khf9n" (OuterVolumeSpecName: "kube-api-access-khf9n") pod "ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a" (UID: "ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a"). InnerVolumeSpecName "kube-api-access-khf9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:55:11.916635 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:11.916533    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a" (UID: "ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:55:12.016056 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:12.016027    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-metrics-certs\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:55:12.016056 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:12.016051    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khf9n\" (UniqueName: \"kubernetes.io/projected/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-kube-api-access-khf9n\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:55:12.016056 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:12.016060    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a-maas-api-tls\") on node \"ip-10-0-132-137.ec2.internal\" DevicePath \"\""
Sep 16 14:55:12.456750 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:12.456714    2582 generic.go:356] "Generic (PLEG): container finished" podID="ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a" containerID="fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52" exitCode=0
Sep 16 14:55:12.456915 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:12.456773    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"
Sep 16 14:55:12.456915 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:12.456798    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8" event={"ID":"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a","Type":"ContainerDied","Data":"fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52"}
Sep 16 14:55:12.456915 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:12.456868    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8" event={"ID":"ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a","Type":"ContainerDied","Data":"f1e3a594b990666ca524b253e78a93854c2141e7cef2f12546941cf1cdd8b941"}
Sep 16 14:55:12.456915 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:12.456889    2582 scope.go:117] "RemoveContainer" containerID="fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52"
Sep 16 14:55:12.466433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:12.466417    2582 scope.go:117] "RemoveContainer" containerID="fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52"
Sep 16 14:55:12.466707 ip-10-0-132-137 kubenswrapper[2582]: E0916 14:55:12.466688    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52\": container with ID starting with fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52 not found: ID does not exist" containerID="fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52"
Sep 16 14:55:12.466767 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:12.466718    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52"} err="failed to get container status \"fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52\": rpc error: code = NotFound desc = could not find container \"fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52\": container with ID starting with fe6d218c6b57810a80f109c843f4976ad122cc885341cdad6465a5998c1d9d52 not found: ID does not exist"
Sep 16 14:55:12.481665 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:12.481642    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"]
Sep 16 14:55:12.488556 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:12.488533    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-8488dbc8b7-4fxv8"]
Sep 16 14:55:13.180013 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:13.179971    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a" path="/var/lib/kubelet/pods/ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a/volumes"
Sep 16 14:55:18.117133 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:18.113851    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:55:24.018864 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:24.018829    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:55:30.852756 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:30.852713    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-4tg7m"]
Sep 16 14:55:39.833708 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:39.833675    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d46d94b58-5lqfb_b93ac95e-353b-4faa-b97c-d56d77b2db3d/manager/0.log"
Sep 16 14:55:39.952102 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:39.952071    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-69v4j_fd29b262-0879-42b7-b202-848228edd0d0/server/0.log"
Sep 16 14:55:40.082899 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:40.082865    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fp8dv_773573a0-e952-47ed-a1a7-0dd0e8afa4c3/manager/0.log"
Sep 16 14:55:40.550495 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:40.550470    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b85944db-wpx5d_65910c5e-0c61-4fb2-8be1-4098344330e0/copy-manifests/0.log"
Sep 16 14:55:40.582489 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:40.582459    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b85944db-wpx5d_65910c5e-0c61-4fb2-8be1-4098344330e0/manager/0.log"
Sep 16 14:55:40.971919 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:40.971838    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6976c56b87-j46wx_493227f8-6817-45d6-b58e-ba879a8f347e/maas-api/0.log"
Sep 16 14:55:42.480988 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:42.480954    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-rlnj6_3ce616e4-90c4-4ad3-b89f-c71d9f0cc79f/manager/0.log"
Sep 16 14:55:42.852791 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:42.852764    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-4tg7m_3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa/limitador/0.log"
Sep 16 14:55:42.976810 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:42.976784    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-zsrvd_78983e1b-de12-4daa-98a4-db8620a8fbfa/manager/0.log"
Sep 16 14:55:43.462652 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:43.462619    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-t8c7r_9b9f21b3-5a2c-4e7c-8638-88172eee7385/discovery/0.log"
Sep 16 14:55:43.705963 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:43.705931    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f575964-l8ggl_69bcb2fc-ddc8-4307-8c5c-93c38a1ba938/kube-auth-proxy/0.log"
Sep 16 14:55:43.830691 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:43.830669    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cj4jw_cd2871ba-e815-4278-85f3-2e4aa481d93f/istio-proxy/1.log"
Sep 16 14:55:44.663639 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:44.663608    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cml24_a54366a4-ebf2-4bb9-8f3f-e9a4ff97d7a2/main/0.log"
Sep 16 14:55:44.908925 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:44.908883    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-q4rks_3267cbc8-1d80-47cb-bd6a-342574468d23/main/0.log"
Sep 16 14:55:50.553353 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:50.553312    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:50.632392 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:50.632362    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:51.361622 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:51.361584    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:53.688936 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:53.688904    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2k2x2_8630dc8c-6050-4063-9fd3-d5f0b96683d2/global-pull-secret-syncer/0.log"
Sep 16 14:55:53.834219 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:53.834192    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dwfhh_2092b9b3-0313-44ff-982e-e9f0f67a955e/konnectivity-agent/0.log"
Sep 16 14:55:53.966096 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:53.966017    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-137.ec2.internal_78732079e26792a8f69e650a5e31b082/haproxy/0.log"
Sep 16 14:55:58.207086 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:58.207046    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-rlnj6_3ce616e4-90c4-4ad3-b89f-c71d9f0cc79f/manager/0.log"
Sep 16 14:55:58.318209 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:58.318181    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-4tg7m_3bcc35ce-a9cf-4973-b21c-cd1ae7a563aa/limitador/0.log"
Sep 16 14:55:58.420892 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:55:58.420862    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-zsrvd_78983e1b-de12-4daa-98a4-db8620a8fbfa/manager/0.log"
Sep 16 14:56:00.629868 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:00.629836    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6wdrj_4c4be10b-96f4-4feb-83f7-4f80df5668b7/node-exporter/0.log"
Sep 16 14:56:00.658057 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:00.658032    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6wdrj_4c4be10b-96f4-4feb-83f7-4f80df5668b7/kube-rbac-proxy/0.log"
Sep 16 14:56:00.706759 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:00.706736    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6wdrj_4c4be10b-96f4-4feb-83f7-4f80df5668b7/init-textfile/0.log"
Sep 16 14:56:01.924494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:01.924463    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df5b668f7-rmq9g_1ea71fb0-a3f9-4861-bf41-b352242ba29a/thanos-query/0.log"
Sep 16 14:56:01.962815 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:01.962785    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df5b668f7-rmq9g_1ea71fb0-a3f9-4861-bf41-b352242ba29a/kube-rbac-proxy-web/0.log"
Sep 16 14:56:02.018681 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:02.018657    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df5b668f7-rmq9g_1ea71fb0-a3f9-4861-bf41-b352242ba29a/kube-rbac-proxy/0.log"
Sep 16 14:56:02.112536 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:02.112507    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df5b668f7-rmq9g_1ea71fb0-a3f9-4861-bf41-b352242ba29a/prom-label-proxy/0.log"
Sep 16 14:56:02.180742 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:02.180668    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df5b668f7-rmq9g_1ea71fb0-a3f9-4861-bf41-b352242ba29a/kube-rbac-proxy-rules/0.log"
Sep 16 14:56:02.258659 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:02.258634    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df5b668f7-rmq9g_1ea71fb0-a3f9-4861-bf41-b352242ba29a/kube-rbac-proxy-metrics/0.log"
Sep 16 14:56:04.842552 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.842515    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"]
Sep 16 14:56:04.843011 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.842889    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a" containerName="maas-api"
Sep 16 14:56:04.843011 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.842902    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a" containerName="maas-api"
Sep 16 14:56:04.843011 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.842970    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebc03d3f-9c45-4f5b-ae1f-ad313eb5330a" containerName="maas-api"
Sep 16 14:56:04.846149 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.846128    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:04.850509 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.850482    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vbsd8\"/\"openshift-service-ca.crt\""
Sep 16 14:56:04.850652 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.850633    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vbsd8\"/\"default-dockercfg-gkpxd\""
Sep 16 14:56:04.851471 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.851454    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vbsd8\"/\"kube-root-ca.crt\""
Sep 16 14:56:04.865494 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.865473    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"]
Sep 16 14:56:04.957551 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.957514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac082d72-1355-49a9-a8cc-5fa33133b7e0-proc\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:04.957686 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.957556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac082d72-1355-49a9-a8cc-5fa33133b7e0-sys\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:04.957686 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.957578    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac082d72-1355-49a9-a8cc-5fa33133b7e0-lib-modules\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:04.957686 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.957649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac082d72-1355-49a9-a8cc-5fa33133b7e0-podres\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:04.957803 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:04.957698    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzxsk\" (UniqueName: \"kubernetes.io/projected/ac082d72-1355-49a9-a8cc-5fa33133b7e0-kube-api-access-gzxsk\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.058559 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.058530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzxsk\" (UniqueName: \"kubernetes.io/projected/ac082d72-1355-49a9-a8cc-5fa33133b7e0-kube-api-access-gzxsk\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.058664 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.058596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac082d72-1355-49a9-a8cc-5fa33133b7e0-proc\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.058664 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.058631    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac082d72-1355-49a9-a8cc-5fa33133b7e0-sys\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.058734 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.058663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac082d72-1355-49a9-a8cc-5fa33133b7e0-lib-modules\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.058734 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.058668    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac082d72-1355-49a9-a8cc-5fa33133b7e0-proc\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.058801 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.058741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac082d72-1355-49a9-a8cc-5fa33133b7e0-sys\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.058801 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.058760    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac082d72-1355-49a9-a8cc-5fa33133b7e0-podres\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.058801 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.058781    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac082d72-1355-49a9-a8cc-5fa33133b7e0-lib-modules\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.058898 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.058879    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac082d72-1355-49a9-a8cc-5fa33133b7e0-podres\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.075483 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.075456    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzxsk\" (UniqueName: \"kubernetes.io/projected/ac082d72-1355-49a9-a8cc-5fa33133b7e0-kube-api-access-gzxsk\") pod \"perf-node-gather-daemonset-qt4bt\" (UID: \"ac082d72-1355-49a9-a8cc-5fa33133b7e0\") " pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.156727 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.156556    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.355691 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.355662    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56887f46f-4nnpw_01bf1a48-38c4-4a27-84de-6781f20ca970/console/0.log"
Sep 16 14:56:05.437184 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.437153    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"]
Sep 16 14:56:05.438795 ip-10-0-132-137 kubenswrapper[2582]: W0916 14:56:05.438771    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac082d72_1355_49a9_a8cc_5fa33133b7e0.slice/crio-e3d56081ff07c4f40a93a9b4b034ebaaa8989a190b675d03c2dddbcd8ce653d0 WatchSource:0}: Error finding container e3d56081ff07c4f40a93a9b4b034ebaaa8989a190b675d03c2dddbcd8ce653d0: Status 404 returned error can't find the container with id e3d56081ff07c4f40a93a9b4b034ebaaa8989a190b675d03c2dddbcd8ce653d0
Sep 16 14:56:05.744557 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.744470    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt" event={"ID":"ac082d72-1355-49a9-a8cc-5fa33133b7e0","Type":"ContainerStarted","Data":"c71624f7f40e06bda6ef83798ba15dba1c342c51356295bbf30c17a543831763"}
Sep 16 14:56:05.744557 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.744526    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt" event={"ID":"ac082d72-1355-49a9-a8cc-5fa33133b7e0","Type":"ContainerStarted","Data":"e3d56081ff07c4f40a93a9b4b034ebaaa8989a190b675d03c2dddbcd8ce653d0"}
Sep 16 14:56:05.744764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.744586    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:05.787304 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:05.787257    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt" podStartSLOduration=1.7872264580000001 podStartE2EDuration="1.787226458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:56:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:56:05.785907211 +0000 UTC m=+2485.079595690" watchObservedRunningTime="2026-09-16 14:56:05.787226458 +0000 UTC m=+2485.080914928"
Sep 16 14:56:07.816004 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:07.815975    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hq5tx_05e7c2ce-ab6b-4c76-b055-53114e2c5442/dns/0.log"
Sep 16 14:56:07.846438 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:07.846395    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hq5tx_05e7c2ce-ab6b-4c76-b055-53114e2c5442/kube-rbac-proxy/0.log"
Sep 16 14:56:07.902764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:07.902741    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jr5mz_9b6f7af5-e7bb-4b1a-9f87-d1611ff6df08/dns-node-resolver/0.log"
Sep 16 14:56:08.896039 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:08.896013    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pt6kn_4f28ab05-ab08-4680-bbf3-217236c89965/node-ca/0.log"
Sep 16 14:56:11.023191 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:11.023159    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-t8c7r_9b9f21b3-5a2c-4e7c-8638-88172eee7385/discovery/0.log"
Sep 16 14:56:11.124252 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:11.124201    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f575964-l8ggl_69bcb2fc-ddc8-4307-8c5c-93c38a1ba938/kube-auth-proxy/0.log"
Sep 16 14:56:11.163419 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:11.163381    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cj4jw_cd2871ba-e815-4278-85f3-2e4aa481d93f/istio-proxy/0.log"
Sep 16 14:56:11.167531 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:11.167511    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cj4jw_cd2871ba-e815-4278-85f3-2e4aa481d93f/istio-proxy/1.log"
Sep 16 14:56:11.760299 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:11.760269    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vbsd8/perf-node-gather-daemonset-qt4bt"
Sep 16 14:56:12.346808 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:12.346777    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tpsrx_22b34b53-183b-496b-8e0a-a559bc0c7e82/serve-healthcheck-canary/0.log"
Sep 16 14:56:13.543439 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:13.543411    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mxsbq_58d50368-0c00-4a2f-ad15-b20e44df5bec/kube-rbac-proxy/0.log"
Sep 16 14:56:13.607357 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:13.607332    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mxsbq_58d50368-0c00-4a2f-ad15-b20e44df5bec/exporter/0.log"
Sep 16 14:56:13.658901 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:13.658877    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mxsbq_58d50368-0c00-4a2f-ad15-b20e44df5bec/extractor/0.log"
Sep 16 14:56:14.347046 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:14.347004    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-t8c7r_9b9f21b3-5a2c-4e7c-8638-88172eee7385/discovery/0.log"
Sep 16 14:56:14.438139 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:14.438113    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f575964-l8ggl_69bcb2fc-ddc8-4307-8c5c-93c38a1ba938/kube-auth-proxy/0.log"
Sep 16 14:56:14.507661 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:14.507630    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cj4jw_cd2871ba-e815-4278-85f3-2e4aa481d93f/istio-proxy/0.log"
Sep 16 14:56:14.521189 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:14.521164    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cj4jw_cd2871ba-e815-4278-85f3-2e4aa481d93f/istio-proxy/1.log"
Sep 16 14:56:17.106673 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:17.106640    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-t8c7r_9b9f21b3-5a2c-4e7c-8638-88172eee7385/discovery/0.log"
Sep 16 14:56:17.463254 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:17.463154    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f575964-l8ggl_69bcb2fc-ddc8-4307-8c5c-93c38a1ba938/kube-auth-proxy/0.log"
Sep 16 14:56:17.559697 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:17.559659    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cj4jw_cd2871ba-e815-4278-85f3-2e4aa481d93f/istio-proxy/0.log"
Sep 16 14:56:17.582764 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:17.582730    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cj4jw_cd2871ba-e815-4278-85f3-2e4aa481d93f/istio-proxy/1.log"
Sep 16 14:56:17.634433 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:17.634405    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d46d94b58-5lqfb_b93ac95e-353b-4faa-b97c-d56d77b2db3d/manager/0.log"
Sep 16 14:56:17.876029 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:17.875999    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-69v4j_fd29b262-0879-42b7-b202-848228edd0d0/server/0.log"
Sep 16 14:56:18.127969 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:18.127939    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fp8dv_773573a0-e952-47ed-a1a7-0dd0e8afa4c3/manager/0.log"
Sep 16 14:56:18.668025 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:18.667993    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b85944db-wpx5d_65910c5e-0c61-4fb2-8be1-4098344330e0/manager/0.log"
Sep 16 14:56:18.811791 ip-10-0-132-137 kubenswrapper[2582]: I0916 14:56:18.811765    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b85944db-wpx5d_65910c5e-0c61-4fb2-8be1-4098344330e0/copy-manifests/0.log"