Jul 10 21:19:05.620167 ip-10-0-141-131 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 10 21:19:05.620200 ip-10-0-141-131 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 10 21:19:05.620209 ip-10-0-141-131 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 10 21:19:05.620525 ip-10-0-141-131 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 10 21:19:15.837688 ip-10-0-141-131 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 10 21:19:15.837706 ip-10-0-141-131 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e69d3979d1314a4a813edccb49a6d8ac --
Jul 10 21:21:14.251599 ip-10-0-141-131 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:14.940768    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945089    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945106    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945111    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945117    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945120    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945125    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945130    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 21:21:14.970503 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945135    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945138    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945142    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945145    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945148    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945152    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945156    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945159    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945162    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945166    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945169    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945172    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945176    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945180    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945184    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945187    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945190    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945193    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945196    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945200    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 21:21:14.974735 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945205    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945210    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945213    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945218    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945223    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945227    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945230    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945233    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945235    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945238    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945242    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945246    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945250    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945252    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945255    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945258    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945261    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945264    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945268    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945272    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 21:21:14.975883 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945275    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945278    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945282    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945284    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945290    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945295    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945298    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945303    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945306    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945310    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945314    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945317    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945321    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945324    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945327    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945331    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945335    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945338    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945341    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 21:21:14.980909 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945343    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945362    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945367    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945372    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945375    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945379    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945382    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945385    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945387    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945390    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945392    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945395    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945399    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945403    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945406    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945410    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945412    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945415    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945418    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945421    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 21:21:14.981687 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945426    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945431    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945434    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945437    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945440    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945444    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945448    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945451    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945454    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945457    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945460    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945464    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.945468    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946363    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946374    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946377    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946380    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946384    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946387    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946390    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 21:21:14.982460 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946393    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946397    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946401    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946404    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946406    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946410    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946414    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946418    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946421    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946424    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946427    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946430    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946433    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946436    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946440    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946442    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946446    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946451    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946455    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946458    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 21:21:14.986739 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946461    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946464    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946467    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946471    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946475    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946478    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946481    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946484    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946487    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946491    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946495    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946502    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946505    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946508    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946512    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946516    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946519    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946525    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946530    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946535    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 21:21:14.987689 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946538    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946541    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946545    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946549    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946553    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946557    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946561    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946564    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946567    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946570    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946574    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946578    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946581    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946584    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946587    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946589    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946594    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946599    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946602    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 21:21:14.988470 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946605    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946607    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946610    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946614    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946620    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946623    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946625    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946628    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946631    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946636    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946640    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946643    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946645    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946648    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946653    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946657    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946661    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946665    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946668    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 21:21:14.990804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946671    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946673    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946677    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946680    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946683    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946687    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946690    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946694    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946698    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946700    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946703    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946706    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946709    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 21:21:14.991599 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:14.946712    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263559    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263581    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263585    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263589    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263593    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263596    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263600    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263604    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263606    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263610    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263613    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263616    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263621    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263626    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263629    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 21:21:15.263620 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263632    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263636    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263639    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263644    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263649    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263652    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263655    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263658    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263661    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263664    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263668    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263670    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263673    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263676    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263679    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263681    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263684    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263687    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263689    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 21:21:15.264104 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263693    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263699    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263704    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263707    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263710    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263714    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263717    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263720    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263723    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263726    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263728    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263731    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263734    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263737    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263739    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263743    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263747    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263750    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263753    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 21:21:15.264608 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263756    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263761    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263764    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263766    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263769    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263772    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263775    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263778    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263781    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263783    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263786    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263789    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263792    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263795    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263798    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263801    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263804    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263807    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263810    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263813    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 21:21:15.265099 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263815    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263818    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263821    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263823    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263826    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263829    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263832    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263834    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263838    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263841    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263845    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263847    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263850    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263853    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263856    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263858    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263861    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263864    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263867    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263870    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 21:21:15.265869 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263873    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263875    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263878    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263880    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263883    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.263885    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.263974    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.263983    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.263990    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.263995    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264000    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264004    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264008    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264013    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264017    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264020    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264024    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264027    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264031    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264034    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264039    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264043    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264046    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 21:21:15.266406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264050    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264056    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264059    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264062    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264066    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264070    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264074    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264077    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264080    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264084    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264088    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264091    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264094    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264098    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264101    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264106    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264109    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264113    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264116    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264120    2575 flags.go:64] FLAG: --enable-server="true"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264123    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264128    2575 flags.go:64] FLAG: --event-burst="100"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264132    2575 flags.go:64] FLAG: --event-qps="50"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264135    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 21:21:15.266995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264139    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264142    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264146    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264149    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264152    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264156    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264160    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264163    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264167    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264170    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264174    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264177    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264180    2575 flags.go:64] FLAG: --feature-gates=""
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264184    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264187    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264191    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264194    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264197    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264201    2575 flags.go:64] FLAG: --help="false"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264204    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264208    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264211    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264214    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264218    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 21:21:15.267615 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264221    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264224    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264228    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264231    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264234    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264237    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264241    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264245    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264248    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264251    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264254    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264257    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264260    2575 flags.go:64] FLAG: --lock-file=""
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264264    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264267    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264271    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264278    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264281    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264284    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264288    2575 flags.go:64] FLAG: --logging-format="text"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264291    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264294    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264297    2575 flags.go:64] FLAG: --manifest-url=""
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264300    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264306    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 21:21:15.268297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264309    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264314    2575 flags.go:64] FLAG: --max-pods="110"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264317    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264320    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264323    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264326    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264330    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264333    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264336    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264345    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264364    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264368    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264372    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264375    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264381    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264385    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264388    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264391    2575 flags.go:64] FLAG: --port="10250"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264395    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264398    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05d1984ab22c472c4"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264403    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264406    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264409    2575 flags.go:64] FLAG: --register-node="true"
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264413    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 10 21:21:15.268961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264417    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264420    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264425    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264428    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264432    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264435    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264439    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264442    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264445    2575 flags.go:64] FLAG: --runonce="false"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264448    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264452    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264455    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264458    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264461    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264465    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264469    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264472    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264476    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264479    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264482    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264493    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264498    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264501    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264504    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264510    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 21:21:15.269608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264514    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264517    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264522    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264526    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264529    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264532    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264535    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264538    2575 flags.go:64] FLAG: --v="2"
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264543    2575 flags.go:64] FLAG: --version="false"
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264548    2575 flags.go:64] FLAG: --vmodule=""
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264553    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.264556    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264702    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264709    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264714    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264717    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264720    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264724    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264726    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264730    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264733    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264735    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 21:21:15.270252 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264738    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264741    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264744    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264747    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264750    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264753    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264757    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264760    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264763    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264765    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264768    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264771    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264774    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264776    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264779    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264782    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264785    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264787    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264790    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264793    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 21:21:15.270830 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264795    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264800    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264803    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264806    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264808    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264811    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264814    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264821    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264824    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264827    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264829    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264832    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264835    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264838    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264841    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264844    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264846    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264849    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264853    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264856    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 21:21:15.271361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264859    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264862    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264865    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264867    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264882    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264885    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264888    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264891    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264894    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264896    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264899    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264902    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264905    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264908    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264912    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264914    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264917    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264921    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264923    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 21:21:15.271902 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264928    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264931    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264933    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264936    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264939    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264942    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264945    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264948    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264951    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264954    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264956    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264959    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264963    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264967    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264970    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264973    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264976    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264978    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264981    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 21:21:15.272446 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264984    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 21:21:15.272933 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264987    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 21:21:15.272933 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264989    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 21:21:15.272933 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264992    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 21:21:15.272933 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.264996    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 21:21:15.272933 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.265000    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 21:21:15.272933 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.265004    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 21:21:15.272933 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.265007    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 21:21:15.272933 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.265010    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 21:21:15.272933 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.265014    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 21:21:15.272933 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.265016    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 21:21:15.272933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.265762    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 21:21:15.273231 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.273166    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 21:21:15.273231 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.273187    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 21:21:15.273231 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.273208    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 21:21:15.273231 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.273215    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 21:21:15.273703 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273689    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 21:21:15.273703 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273701    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 21:21:15.273703 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273705    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273708    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273712    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273717    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273721    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273725    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273729    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273733    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273736    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273739    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273742    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273746    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273749    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273752    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273755    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273757    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273760    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273763    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273766    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273769    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 21:21:15.273795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273772    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273775    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273778    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273782    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273786    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273790    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273793    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273797    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273800    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273804    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273807    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273811    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273814    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273817    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273820    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273823    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273826    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273829    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273833    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 21:21:15.274304 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273836    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273839    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273842    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273845    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273848    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273851    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273854    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273857    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273860    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273862    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273865    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273868    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273870    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273873    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273876    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273880    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273883    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273892    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273895    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273898    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 21:21:15.274867 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273900    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273903    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273906    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273909    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273912    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273914    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273917    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273920    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273923    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273926    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273928    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273931    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273934    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273937    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273940    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273943    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273946    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273948    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273951    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 21:21:15.275395 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273954    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273956    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273959    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273961    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273964    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273967    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273969    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273972    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273975    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273979    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273982    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273986    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273989    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273992    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273994    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.273997    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274000    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274003    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 21:21:15.275877 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274005    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.274011    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274139    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274144    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274147    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274151    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274153    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274157    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274160    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274164    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274166    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274169    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274172    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274175    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274177    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 21:21:15.276357 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274180    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274183    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274186    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274189    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274192    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274195    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274198    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274201    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274205    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274208    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274211    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274215    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274217    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274220    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274223    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274226    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274229    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274231    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274234    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274237    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 21:21:15.276752 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274240    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274242    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274245    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274248    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274250    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274253    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274256    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274258    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274261    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274264    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274266    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274269    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274272    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274274    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274277    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274280    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274283    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274285    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274289    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274292    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 21:21:15.277258 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274295    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274298    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274301    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274304    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274307    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274310    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274313    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274318    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274321    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274324    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274328    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274331    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274333    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274336    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274339    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274343    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274363    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274367    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274370    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274373    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 21:21:15.277822 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274375    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274378    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274381    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274384    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274387    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274389    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274392    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274395    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274398    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274400    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274403    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274406    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274409    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274412    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274416    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274419    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274422    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274425    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274428    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 21:21:15.278361 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274431    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 21:21:15.278895 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274433    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 21:21:15.278895 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274438    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 21:21:15.278895 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274441    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 21:21:15.278895 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274444    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 21:21:15.278895 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274447    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 21:21:15.278895 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:15.274450    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 21:21:15.278895 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.274455    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 21:21:15.278895 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.274601    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 21:21:15.278895 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.278462    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 21:21:15.280026 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.280013    2575 server.go:1019] "Starting client certificate rotation"
Jul 10 21:21:15.280144 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.280123    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 21:21:15.280190 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.280160    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 21:21:15.282852 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.282837    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 21:21:15.286906 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.286887    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 21:21:15.299326 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.299301    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 10 21:21:15.302563 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.302538    2575 log.go:25] "Validated CRI v1 image API"
Jul 10 21:21:15.303421 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.303403    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 21:21:15.306734 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.306711    2575 fs.go:135] Filesystem UUIDs: map[1d278832-22a9-4d57-b2b8-ba78051c468b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 be0c3933-aa96-43b6-baa6-f19d547e7f10:/dev/nvme0n1p3]
Jul 10 21:21:15.306801 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.306733    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 21:21:15.311897 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.311874    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 21:21:15.314107 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.313989    2575 manager.go:216] Machine: {Timestamp:2026-07-10 21:21:15.312520513 +0000 UTC m=+0.945765760 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087571 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26cbc79f3cea8bc28e501f059b30c0 SystemUUID:ec26cbc7-9f3c-ea8b-c28e-501f059b30c0 BootID:e69d3979-d131-4a4a-813e-dccb49a6d8ac Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:66:68:3f:4d:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:66:68:3f:4d:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:51:08:c7:a9:9e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 21:21:15.314107 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.314105    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 21:21:15.314229 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.314202    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 21:21:15.317505 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.317481    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 21:21:15.317653 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.317509    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-131.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 21:21:15.318190 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.318179    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 21:21:15.318224 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.318192    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 21:21:15.318224 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.318200    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 21:21:15.318873 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.318861    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 21:21:15.319716 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.319705    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 21:21:15.322696 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.322683    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 21:21:15.322822 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.322813    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 21:21:15.322862 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.322843    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 21:21:15.322862 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.322853    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 21:21:15.322924 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.322870    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 21:21:15.322924 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.322881    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 10 21:21:15.322924 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.322895    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 21:21:15.323339 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.323325    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 21:21:15.323399 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.323362    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 21:21:15.325996 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.325977    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 21:21:15.327575 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.327556    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 21:21:15.327660 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.327598    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 21:21:15.328283 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.328266    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 21:21:15.328368 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.328288    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 21:21:15.328368 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.328298    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 21:21:15.328368 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.328307    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 21:21:15.328368 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.328320    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 21:21:15.328368 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.328329    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 21:21:15.328564 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.328552    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 21:21:15.328616 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.328567    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 21:21:15.328616 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.328578    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 21:21:15.328616 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.328590    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 21:21:15.328616 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.328604    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 21:21:15.328616 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.328617    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 21:21:15.329299 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.329288    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 21:21:15.329367 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.329302    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 21:21:15.332930 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.332911    2575 server.go:1268] "Started kubelet"
Jul 10 21:21:15.333054 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.333017    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 21:21:15.333113 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.333021    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 21:21:15.333180 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.333118    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 21:21:15.333957 ip-10-0-141-131 systemd[1]: Started Kubernetes Kubelet.
Jul 10 21:21:15.334737 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.334714    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 21:21:15.335680 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.335665    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 21:21:15.337564 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.337542    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 21:21:15.337564 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.337559    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-131.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 21:21:15.337791 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.337557    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-131.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 21:21:15.337791 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.337562    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 21:21:15.339641 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.339620    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 21:21:15.339641 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.339621    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 21:21:15.339783 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.339739    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:15.340538 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.340390    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 21:21:15.340538 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.340499    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 21:21:15.340538 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.340515    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 21:21:15.340719 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.340579    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 21:21:15.340719 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.340590    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 21:21:15.340849 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.340834    2575 factory.go:55] Registering systemd factory
Jul 10 21:21:15.340884 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.340850    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 10 21:21:15.341068 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.341055    2575 factory.go:153] Registering CRI-O factory
Jul 10 21:21:15.341137 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.341073    2575 factory.go:223] Registration of the crio container factory successfully
Jul 10 21:21:15.341137 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.341121    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 21:21:15.341246 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.341142    2575 factory.go:103] Registering Raw factory
Jul 10 21:21:15.341246 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.341154    2575 manager.go:1196] Started watching for new ooms in manager
Jul 10 21:21:15.341815 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.341787    2575 manager.go:349] Starting recovery of all containers
Jul 10 21:21:15.342372 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.342348    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 21:21:15.343021 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.342989    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-131.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 21:21:15.343794 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.342530    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-131.ec2.internal.18c10a80b5847c72  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-131.ec2.internal,UID:ip-10-0-141-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-131.ec2.internal,},FirstTimestamp:2026-07-10 21:21:15.332877426 +0000 UTC m=+0.966122674,LastTimestamp:2026-07-10 21:21:15.332877426 +0000 UTC m=+0.966122674,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-131.ec2.internal,}"
Jul 10 21:21:15.350015 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.349983    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vvcmj"
Jul 10 21:21:15.355411 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.355252    2575 manager.go:354] Recovery completed
Jul 10 21:21:15.359196 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.359176    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vvcmj"
Jul 10 21:21:15.359694 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.359681    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 21:21:15.361698 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.361679    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 21:21:15.361783 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.361719    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 21:21:15.361783 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.361737    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID"
Jul 10 21:21:15.362526 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.362509    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 21:21:15.362526 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.362520    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 21:21:15.362650 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.362534    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 21:21:15.362650 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.362552    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 21:21:15.363342 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.363323    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 21:21:15.363413 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.363357    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 21:21:15.363413 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.363373    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID"
Jul 10 21:21:15.363752 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.363740    2575 policy_none.go:49] "None policy: Start"
Jul 10 21:21:15.363809 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.363760    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 21:21:15.363809 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.363771    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 21:21:15.363897 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.363830    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-131.ec2.internal.18c10a80b73c4405  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-131.ec2.internal,UID:ip-10-0-141-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-131.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-131.ec2.internal,},FirstTimestamp:2026-07-10 21:21:15.361698821 +0000 UTC m=+0.994944073,LastTimestamp:2026-07-10 21:21:15.361698821 +0000 UTC m=+0.994944073,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-131.ec2.internal,}"
Jul 10 21:21:15.364878 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.364866    2575 policy_none.go:47] "Start"
Jul 10 21:21:15.406013 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.405997    2575 manager.go:337] "Starting Device Plugin manager"
Jul 10 21:21:15.406104 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.406034    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 21:21:15.406104 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.406045    2575 server.go:87] "Starting device plugin registration server"
Jul 10 21:21:15.406404 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.406376    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 21:21:15.406511 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.406399    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 21:21:15.406638 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.406574    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 21:21:15.406743 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.406669    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 21:21:15.406743 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.406679    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 21:21:15.407233 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.407210    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 21:21:15.407340 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.407262    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:15.508494 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.508447    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 21:21:15.509690 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.509568    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 21:21:15.509690 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.509603    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 21:21:15.509690 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.509618    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID"
Jul 10 21:21:15.509690 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.509648    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.515303 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.515243    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 21:21:15.516554 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.516532    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.516554 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.516550    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 21:21:15.516727 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.516566    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-131.ec2.internal\": node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:15.516727 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.516586    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 21:21:15.516727 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.516608    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 21:21:15.516727 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.516641    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 21:21:15.518852 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.518830    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 21:21:15.553819 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.553781    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:15.616842 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.616799    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal"]
Jul 10 21:21:15.617017 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.616890    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 21:21:15.618004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.617986    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 21:21:15.618092 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.618028    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 21:21:15.618092 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.618046    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID"
Jul 10 21:21:15.619614 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.619598    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 21:21:15.619747 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.619729    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.619811 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.619771    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 21:21:15.620472 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.620449    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 21:21:15.620563 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.620449    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 21:21:15.620563 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.620483    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 21:21:15.620563 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.620500    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID"
Jul 10 21:21:15.620563 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.620509    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 21:21:15.620563 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.620523    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID"
Jul 10 21:21:15.622084 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.622067    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.622169 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.622095    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 21:21:15.622797 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.622779    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 21:21:15.622894 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.622811    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 21:21:15.622894 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.622825    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID"
Jul 10 21:21:15.642332 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.642311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ecc83a09f011f0ef47edc46335385adf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal\" (UID: \"ecc83a09f011f0ef47edc46335385adf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.642453 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.642345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecc83a09f011f0ef47edc46335385adf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal\" (UID: \"ecc83a09f011f0ef47edc46335385adf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.642453 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.642386    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee9ba87a95626305bc9fc31aaeb61c99-config\") pod \"kube-apiserver-proxy-ip-10-0-141-131.ec2.internal\" (UID: \"ee9ba87a95626305bc9fc31aaeb61c99\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.653261 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.653243    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-131.ec2.internal\" not found" node="ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.653987 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.653969    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:15.658282 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.658263    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-131.ec2.internal\" not found" node="ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.743046 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.743016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee9ba87a95626305bc9fc31aaeb61c99-config\") pod \"kube-apiserver-proxy-ip-10-0-141-131.ec2.internal\" (UID: \"ee9ba87a95626305bc9fc31aaeb61c99\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.743046 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.743047    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ecc83a09f011f0ef47edc46335385adf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal\" (UID: \"ecc83a09f011f0ef47edc46335385adf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.743217 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.743065    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecc83a09f011f0ef47edc46335385adf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal\" (UID: \"ecc83a09f011f0ef47edc46335385adf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.743217 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.743120    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecc83a09f011f0ef47edc46335385adf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal\" (UID: \"ecc83a09f011f0ef47edc46335385adf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.743217 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.743148    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee9ba87a95626305bc9fc31aaeb61c99-config\") pod \"kube-apiserver-proxy-ip-10-0-141-131.ec2.internal\" (UID: \"ee9ba87a95626305bc9fc31aaeb61c99\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.743217 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.743145    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ecc83a09f011f0ef47edc46335385adf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal\" (UID: \"ecc83a09f011f0ef47edc46335385adf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.754892 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.754872    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:15.855064 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.854976    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:15.955102 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:15.955070    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:15.956295 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.956266    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:15.962609 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:15.962585    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:16.055404 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:16.055364    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:16.156090 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:16.156003    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:16.256312 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:16.256266    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:16.279613 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:16.279566    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 21:21:16.279817 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:16.279792    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 21:21:16.356731 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:16.356699    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:16.363358 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:16.363260    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 21:16:15 +0000 UTC" deadline="2028-02-26 00:43:57.875632364 +0000 UTC"
Jul 10 21:21:16.363358 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:16.363350    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14283h22m41.512287681s"
Jul 10 21:21:16.380257 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:16.380214    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 21:21:16.457476 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:16.457390    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:16.558431 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:16.558395    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:16.625523 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:16.625482    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9ba87a95626305bc9fc31aaeb61c99.slice/crio-d120663b5eeea975b05bd90628268a4d4ad1956da279f69fefa5d250e41d8d46 WatchSource:0}: Error finding container d120663b5eeea975b05bd90628268a4d4ad1956da279f69fefa5d250e41d8d46: Status 404 returned error can't find the container with id d120663b5eeea975b05bd90628268a4d4ad1956da279f69fefa5d250e41d8d46
Jul 10 21:21:16.625784 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:16.625763    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc83a09f011f0ef47edc46335385adf.slice/crio-0ebff2617b32783b36abc3798bb6c700ae3339bb5e2322792a738f3d616e4caf WatchSource:0}: Error finding container 0ebff2617b32783b36abc3798bb6c700ae3339bb5e2322792a738f3d616e4caf: Status 404 returned error can't find the container with id 0ebff2617b32783b36abc3798bb6c700ae3339bb5e2322792a738f3d616e4caf
Jul 10 21:21:16.630211 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:16.630190    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 21:21:16.659157 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:16.659128    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:16.697914 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:16.697882    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 21:21:16.760336 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:16.760238    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:16.861359 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:16.861331    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found"
Jul 10 21:21:16.900328 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:16.900304    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 21:21:16.940440 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:16.940393    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:16.954465 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:16.954439    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 21:21:16.955739 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:16.955720    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal"
Jul 10 21:21:16.963284 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:16.963268    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 21:21:17.263528 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.263502    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 21:21:17.327509 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.327457    2575 apiserver.go:52] "Watching apiserver"
Jul 10 21:21:17.336980 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.336952    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 21:21:17.337502 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.337463    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-vsh7h","openshift-image-registry/node-ca-4xzxz","openshift-multus/multus-fm8sc","openshift-multus/network-metrics-daemon-l8sdv","openshift-ovn-kubernetes/ovnkube-node-n9lqx","kube-system/global-pull-secret-syncer-279g5","kube-system/konnectivity-agent-mn7bk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal","openshift-multus/multus-additional-cni-plugins-xvw4p","openshift-network-diagnostics/network-check-target-4g72n","openshift-network-operator/iptables-alerter-kvq7g","kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ktwkl"]
Jul 10 21:21:17.340632 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.340606    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 21:21:17.341519 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.341491    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mn7bk"
Jul 10 21:21:17.344148 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.343882    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:17.344148 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:17.343958    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:17.345621 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.345597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pnnkk\""
Jul 10 21:21:17.347115 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.345891    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 21:21:17.347115 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.346484    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 21:21:17.347115 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.346657    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.348580 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.348385    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:17.348580 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:17.348452    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:17.349664 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.349630    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 21:21:17.349960 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.349841    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 21:21:17.349960 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.349880    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 21:21:17.349960 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.349954    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 21:21:17.351164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.351143    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.352410 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.352225    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7v5bn\""
Jul 10 21:21:17.354398 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.354266    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:17.354398 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:17.354357    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:17.356220 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.355222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c397e828-d1fc-45f4-bd7e-23848f0e5ab6-agent-certs\") pod \"konnectivity-agent-mn7bk\" (UID: \"c397e828-d1fc-45f4-bd7e-23848f0e5ab6\") " pod="kube-system/konnectivity-agent-mn7bk"
Jul 10 21:21:17.356220 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.355260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c397e828-d1fc-45f4-bd7e-23848f0e5ab6-konnectivity-ca\") pod \"konnectivity-agent-mn7bk\" (UID: \"c397e828-d1fc-45f4-bd7e-23848f0e5ab6\") " pod="kube-system/konnectivity-agent-mn7bk"
Jul 10 21:21:17.356220 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.355894    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.358164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.357653    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5dqhx\""
Jul 10 21:21:17.358164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.357721    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 21:21:17.358164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.357920    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 21:21:17.358385 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.358319    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 21:21:17.358532 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.358514    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 21:21:17.358649 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.358636    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.358724 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.358714    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 21:21:17.359056 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.359039    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 21:21:17.359544 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.359525    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cqfbj\""
Jul 10 21:21:17.360207 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.360186    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 21:21:17.361011 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.360605    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4xzxz"
Jul 10 21:21:17.363127 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.362998    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 21:21:17.366612 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.364523    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.366612 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.364776    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 21:21:17.366612 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.365880    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 21:21:17.369678 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.368628    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 21:21:17.369678 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.368881    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 21:21:17.369678 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.368883    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 21:21:17.369678 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.368971    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qsz77\""
Jul 10 21:21:17.369678 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.369017    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k57g9\""
Jul 10 21:21:17.369678 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.369147    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 21:21:17.369678 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.369248    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 21:21:17.369678 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.369253    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wbrw2\""
Jul 10 21:21:17.369678 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.369388    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 21:21:17.371747 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.371366    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vsh7h"
Jul 10 21:21:17.374079 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.374048    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 21:21:17.375067 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.374428    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kvq7g"
Jul 10 21:21:17.375067 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.374628    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 21:21:17.375067 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.374919    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-klbsf\""
Jul 10 21:21:17.377225 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.377208    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 21:21:17.378045 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.378023    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rgjzk\""
Jul 10 21:21:17.378129 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.378096    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 21:21:17.378275 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.378021    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 21:21:17.380808 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.380725    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 21:21:17.412535 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.412509    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-25hqx"
Jul 10 21:21:17.425307 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.425284    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-25hqx"
Jul 10 21:21:17.442064 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.442033    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 21:21:17.455461 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455421    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.455461 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-kubernetes\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.455660 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455499    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-lib-modules\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.455660 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vdjd\" (UniqueName: \"kubernetes.io/projected/67af6855-5931-4939-9bcf-c8b5d4f720c7-kube-api-access-5vdjd\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.455660 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455556    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.455660 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455582    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50c2c491-0a3d-46df-8992-e3360667a5a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.455660 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455617    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c397e828-d1fc-45f4-bd7e-23848f0e5ab6-konnectivity-ca\") pod \"konnectivity-agent-mn7bk\" (UID: \"c397e828-d1fc-45f4-bd7e-23848f0e5ab6\") " pod="kube-system/konnectivity-agent-mn7bk"
Jul 10 21:21:17.455660 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-run-netns\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-var-lib-cni-bin\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455692    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-multus-conf-dir\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455716    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-etc-kubernetes\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455760    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-host\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67af6855-5931-4939-9bcf-c8b5d4f720c7-tmp\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-socket-dir\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e7c9701-d078-40ac-8c5d-862e417b0f9d-cni-binary-copy\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rrpv\" (UniqueName: \"kubernetes.io/projected/0e7c9701-d078-40ac-8c5d-862e417b0f9d-kube-api-access-9rrpv\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-run-systemd\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.455970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-ovnkube-script-lib\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-sysctl-conf\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zpcp\" (UniqueName: \"kubernetes.io/projected/69a397c0-e18d-435c-b66e-3557a9bb5851-kube-api-access-9zpcp\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:17.456051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456057    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-registration-dir\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-device-dir\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c397e828-d1fc-45f4-bd7e-23848f0e5ab6-agent-certs\") pod \"konnectivity-agent-mn7bk\" (UID: \"c397e828-d1fc-45f4-bd7e-23848f0e5ab6\") " pod="kube-system/konnectivity-agent-mn7bk"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92b95e58-9d5d-4939-bb6e-c6b0c246546f-hosts-file\") pod \"node-resolver-vsh7h\" (UID: \"92b95e58-9d5d-4939-bb6e-c6b0c246546f\") " pod="openshift-dns/node-resolver-vsh7h"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-cnibin\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-cni-bin\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-sysctl-d\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d58d1e4-af64-4f0c-972e-a2e02bc12421-host\") pod \"node-ca-4xzxz\" (UID: \"7d58d1e4-af64-4f0c-972e-a2e02bc12421\") " pod="openshift-image-registry/node-ca-4xzxz"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456335    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50c2c491-0a3d-46df-8992-e3360667a5a3-os-release\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-run-k8s-cni-cncf-io\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456422    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-node-log\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50c2c491-0a3d-46df-8992-e3360667a5a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456478    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz5qr\" (UniqueName: \"kubernetes.io/projected/50c2c491-0a3d-46df-8992-e3360667a5a3-kube-api-access-pz5qr\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456507    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbl27\" (UniqueName: \"kubernetes.io/projected/92b95e58-9d5d-4939-bb6e-c6b0c246546f-kube-api-access-hbl27\") pod \"node-resolver-vsh7h\" (UID: \"92b95e58-9d5d-4939-bb6e-c6b0c246546f\") " pod="openshift-dns/node-resolver-vsh7h"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456504    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456535    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-hostroot\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.456725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh677\" (UniqueName: \"kubernetes.io/projected/82b782ff-c8bb-4f58-8d39-a59e7e9ae289-kube-api-access-wh677\") pod \"iptables-alerter-kvq7g\" (UID: \"82b782ff-c8bb-4f58-8d39-a59e7e9ae289\") " pod="openshift-network-operator/iptables-alerter-kvq7g"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50c2c491-0a3d-46df-8992-e3360667a5a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-multus-socket-dir-parent\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-cni-netd\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-env-overrides\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28dsq\" (UniqueName: \"kubernetes.io/projected/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-kube-api-access-28dsq\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-sys\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456828    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-sys-fs\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-sysconfig\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-run\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-var-lib-kubelet\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.456972    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e7c9701-d078-40ac-8c5d-862e417b0f9d-multus-daemon-config\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-os-release\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457044    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-multus-cni-dir\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457067    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c397e828-d1fc-45f4-bd7e-23848f0e5ab6-konnectivity-ca\") pod \"konnectivity-agent-mn7bk\" (UID: \"c397e828-d1fc-45f4-bd7e-23848f0e5ab6\") " pod="kube-system/konnectivity-agent-mn7bk"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-slash\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457100    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-run-netns\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.457557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457127    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457161    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-var-lib-kubelet\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457210    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82b782ff-c8bb-4f58-8d39-a59e7e9ae289-host-slash\") pod \"iptables-alerter-kvq7g\" (UID: \"82b782ff-c8bb-4f58-8d39-a59e7e9ae289\") " pod="openshift-network-operator/iptables-alerter-kvq7g"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457248    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50c2c491-0a3d-46df-8992-e3360667a5a3-system-cni-dir\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-run-multus-certs\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457330    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-kubelet-config\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-run-openvswitch\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-run-ovn\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-ovnkube-config\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-tuned\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzhbg\" (UniqueName: \"kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg\") pod \"network-check-target-4g72n\" (UID: \"ab9864ff-802f-4b23-baf5-e15e761ff147\") " pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457547    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-var-lib-cni-multus\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-ovn-node-metrics-cert\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92b95e58-9d5d-4939-bb6e-c6b0c246546f-tmp-dir\") pod \"node-resolver-vsh7h\" (UID: \"92b95e58-9d5d-4939-bb6e-c6b0c246546f\") " pod="openshift-dns/node-resolver-vsh7h"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457636    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-kubelet\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.458517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-log-socket\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457711    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d58d1e4-af64-4f0c-972e-a2e02bc12421-serviceca\") pod \"node-ca-4xzxz\" (UID: \"7d58d1e4-af64-4f0c-972e-a2e02bc12421\") " pod="openshift-image-registry/node-ca-4xzxz"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457742    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-var-lib-openvswitch\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-dbus\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457830    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vh4f\" (UniqueName: \"kubernetes.io/projected/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-kube-api-access-8vh4f\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457860    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50c2c491-0a3d-46df-8992-e3360667a5a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-system-cni-dir\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457932    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-systemd-units\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82b782ff-c8bb-4f58-8d39-a59e7e9ae289-iptables-alerter-script\") pod \"iptables-alerter-kvq7g\" (UID: \"82b782ff-c8bb-4f58-8d39-a59e7e9ae289\") " pod="openshift-network-operator/iptables-alerter-kvq7g"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.457985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9x9c\" (UniqueName: \"kubernetes.io/projected/7d58d1e4-af64-4f0c-972e-a2e02bc12421-kube-api-access-c9x9c\") pod \"node-ca-4xzxz\" (UID: \"7d58d1e4-af64-4f0c-972e-a2e02bc12421\") " pod="openshift-image-registry/node-ca-4xzxz"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.458022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-modprobe-d\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.458062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-systemd\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.458088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.458115    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50c2c491-0a3d-46df-8992-e3360667a5a3-cnibin\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.459184 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.458143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-etc-openvswitch\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.460782 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.460758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c397e828-d1fc-45f4-bd7e-23848f0e5ab6-agent-certs\") pod \"konnectivity-agent-mn7bk\" (UID: \"c397e828-d1fc-45f4-bd7e-23848f0e5ab6\") " pod="kube-system/konnectivity-agent-mn7bk"
Jul 10 21:21:17.523123 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.522998    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal" event={"ID":"ee9ba87a95626305bc9fc31aaeb61c99","Type":"ContainerStarted","Data":"d120663b5eeea975b05bd90628268a4d4ad1956da279f69fefa5d250e41d8d46"}
Jul 10 21:21:17.524415 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.524375    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" event={"ID":"ecc83a09f011f0ef47edc46335385adf","Type":"ContainerStarted","Data":"0ebff2617b32783b36abc3798bb6c700ae3339bb5e2322792a738f3d616e4caf"}
Jul 10 21:21:17.558537 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92b95e58-9d5d-4939-bb6e-c6b0c246546f-tmp-dir\") pod \"node-resolver-vsh7h\" (UID: \"92b95e58-9d5d-4939-bb6e-c6b0c246546f\") " pod="openshift-dns/node-resolver-vsh7h"
Jul 10 21:21:17.558537 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-kubelet\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.558788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558555    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-log-socket\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.558788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d58d1e4-af64-4f0c-972e-a2e02bc12421-serviceca\") pod \"node-ca-4xzxz\" (UID: \"7d58d1e4-af64-4f0c-972e-a2e02bc12421\") " pod="openshift-image-registry/node-ca-4xzxz"
Jul 10 21:21:17.558788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-var-lib-openvswitch\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.558788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558628    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-kubelet\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.558788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558662    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-log-socket\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.558788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-dbus\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:17.558788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vh4f\" (UniqueName: \"kubernetes.io/projected/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-kube-api-access-8vh4f\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.558788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558761    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50c2c491-0a3d-46df-8992-e3360667a5a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.558788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558769    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-var-lib-openvswitch\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.558788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-system-cni-dir\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-systemd-units\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558834    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82b782ff-c8bb-4f58-8d39-a59e7e9ae289-iptables-alerter-script\") pod \"iptables-alerter-kvq7g\" (UID: \"82b782ff-c8bb-4f58-8d39-a59e7e9ae289\") " pod="openshift-network-operator/iptables-alerter-kvq7g"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9x9c\" (UniqueName: \"kubernetes.io/projected/7d58d1e4-af64-4f0c-972e-a2e02bc12421-kube-api-access-c9x9c\") pod \"node-ca-4xzxz\" (UID: \"7d58d1e4-af64-4f0c-972e-a2e02bc12421\") " pod="openshift-image-registry/node-ca-4xzxz"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558882    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-dbus\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-modprobe-d\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558918    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-systemd-units\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-systemd\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558977    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-system-cni-dir\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50c2c491-0a3d-46df-8992-e3360667a5a3-cnibin\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559034    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50c2c491-0a3d-46df-8992-e3360667a5a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.558916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92b95e58-9d5d-4939-bb6e-c6b0c246546f-tmp-dir\") pod \"node-resolver-vsh7h\" (UID: \"92b95e58-9d5d-4939-bb6e-c6b0c246546f\") " pod="openshift-dns/node-resolver-vsh7h"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-etc-openvswitch\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559112    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-modprobe-d\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559119    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-systemd\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559123    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.559403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-kubernetes\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559185    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d58d1e4-af64-4f0c-972e-a2e02bc12421-serviceca\") pod \"node-ca-4xzxz\" (UID: \"7d58d1e4-af64-4f0c-972e-a2e02bc12421\") " pod="openshift-image-registry/node-ca-4xzxz"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:17.559196    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-lib-modules\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdjd\" (UniqueName: \"kubernetes.io/projected/67af6855-5931-4939-9bcf-c8b5d4f720c7-kube-api-access-5vdjd\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:17.559255    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs podName:69a397c0-e18d-435c-b66e-3557a9bb5851 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:18.059239037 +0000 UTC m=+3.692484271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs") pod "network-metrics-daemon-l8sdv" (UID: "69a397c0-e18d-435c-b66e-3557a9bb5851") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559339    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50c2c491-0a3d-46df-8992-e3360667a5a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559343    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-lib-modules\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-run-netns\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559402    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-etc-openvswitch\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559422    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-var-lib-cni-bin\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559466    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-kubernetes\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559473    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-var-lib-cni-bin\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559496    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50c2c491-0a3d-46df-8992-e3360667a5a3-cnibin\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559510    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-run-netns\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.560247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-multus-conf-dir\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559549    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559579    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-etc-kubernetes\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-multus-conf-dir\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559612    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-host\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559641    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67af6855-5931-4939-9bcf-c8b5d4f720c7-tmp\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-socket-dir\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559684    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e7c9701-d078-40ac-8c5d-862e417b0f9d-cni-binary-copy\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559696    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-host\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rrpv\" (UniqueName: \"kubernetes.io/projected/0e7c9701-d078-40ac-8c5d-862e417b0f9d-kube-api-access-9rrpv\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559796    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-run-systemd\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559807    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82b782ff-c8bb-4f58-8d39-a59e7e9ae289-iptables-alerter-script\") pod \"iptables-alerter-kvq7g\" (UID: \"82b782ff-c8bb-4f58-8d39-a59e7e9ae289\") " pod="openshift-network-operator/iptables-alerter-kvq7g"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-ovnkube-script-lib\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-sysctl-conf\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zpcp\" (UniqueName: \"kubernetes.io/projected/69a397c0-e18d-435c-b66e-3557a9bb5851-kube-api-access-9zpcp\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-registration-dir\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559881    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-socket-dir\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.561164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-device-dir\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92b95e58-9d5d-4939-bb6e-c6b0c246546f-hosts-file\") pod \"node-resolver-vsh7h\" (UID: \"92b95e58-9d5d-4939-bb6e-c6b0c246546f\") " pod="openshift-dns/node-resolver-vsh7h"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-cnibin\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560118    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50c2c491-0a3d-46df-8992-e3360667a5a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-etc-kubernetes\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560271    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-registration-dir\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-device-dir\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-run-systemd\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560453    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-sysctl-conf\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560468    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92b95e58-9d5d-4939-bb6e-c6b0c246546f-hosts-file\") pod \"node-resolver-vsh7h\" (UID: \"92b95e58-9d5d-4939-bb6e-c6b0c246546f\") " pod="openshift-dns/node-resolver-vsh7h"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-cnibin\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.559997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-cni-bin\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560568    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-sysctl-d\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560567    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-cni-bin\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560645    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d58d1e4-af64-4f0c-972e-a2e02bc12421-host\") pod \"node-ca-4xzxz\" (UID: \"7d58d1e4-af64-4f0c-972e-a2e02bc12421\") " pod="openshift-image-registry/node-ca-4xzxz"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560676    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-sysctl-d\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.561987 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560692    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50c2c491-0a3d-46df-8992-e3360667a5a3-os-release\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d58d1e4-af64-4f0c-972e-a2e02bc12421-host\") pod \"node-ca-4xzxz\" (UID: \"7d58d1e4-af64-4f0c-972e-a2e02bc12421\") " pod="openshift-image-registry/node-ca-4xzxz"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560732    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e7c9701-d078-40ac-8c5d-862e417b0f9d-cni-binary-copy\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.560720    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-run-k8s-cni-cncf-io\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.561108    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50c2c491-0a3d-46df-8992-e3360667a5a3-os-release\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.561397    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-run-k8s-cni-cncf-io\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.561477    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-node-log\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.561524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50c2c491-0a3d-46df-8992-e3360667a5a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.561567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz5qr\" (UniqueName: \"kubernetes.io/projected/50c2c491-0a3d-46df-8992-e3360667a5a3-kube-api-access-pz5qr\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.561647    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbl27\" (UniqueName: \"kubernetes.io/projected/92b95e58-9d5d-4939-bb6e-c6b0c246546f-kube-api-access-hbl27\") pod \"node-resolver-vsh7h\" (UID: \"92b95e58-9d5d-4939-bb6e-c6b0c246546f\") " pod="openshift-dns/node-resolver-vsh7h"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.561680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-hostroot\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.562011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-hostroot\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.562276    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-ovnkube-script-lib\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.562338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-node-log\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.562744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50c2c491-0a3d-46df-8992-e3360667a5a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.562886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.562794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh677\" (UniqueName: \"kubernetes.io/projected/82b782ff-c8bb-4f58-8d39-a59e7e9ae289-kube-api-access-wh677\") pod \"iptables-alerter-kvq7g\" (UID: \"82b782ff-c8bb-4f58-8d39-a59e7e9ae289\") " pod="openshift-network-operator/iptables-alerter-kvq7g"
Jul 10 21:21:17.563591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.562965    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50c2c491-0a3d-46df-8992-e3360667a5a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.563591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-multus-socket-dir-parent\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.563591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-cni-netd\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.563591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-env-overrides\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.563591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67af6855-5931-4939-9bcf-c8b5d4f720c7-tmp\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.563591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28dsq\" (UniqueName: \"kubernetes.io/projected/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-kube-api-access-28dsq\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.563591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563172    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-cni-netd\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.563591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563372    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-multus-socket-dir-parent\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.563591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-sys\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.563591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-sys-fs\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.563591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563520    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-sysconfig\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.563591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-run\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563569    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-sys\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563607    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-var-lib-kubelet\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563658    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e7c9701-d078-40ac-8c5d-862e417b0f9d-multus-daemon-config\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-os-release\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-multus-cni-dir\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563802    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-sysconfig\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-slash\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563834    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-env-overrides\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563867    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-run-netns\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563893    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50c2c491-0a3d-46df-8992-e3360667a5a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563888    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-sys-fs\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.563989    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564001    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-os-release\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564022    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-var-lib-kubelet\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564075    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-slash\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82b782ff-c8bb-4f58-8d39-a59e7e9ae289-host-slash\") pod \"iptables-alerter-kvq7g\" (UID: \"82b782ff-c8bb-4f58-8d39-a59e7e9ae289\") " pod="openshift-network-operator/iptables-alerter-kvq7g"
Jul 10 21:21:17.564139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-run\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564138    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82b782ff-c8bb-4f58-8d39-a59e7e9ae289-host-slash\") pod \"iptables-alerter-kvq7g\" (UID: \"82b782ff-c8bb-4f58-8d39-a59e7e9ae289\") " pod="openshift-network-operator/iptables-alerter-kvq7g"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564148    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-multus-cni-dir\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564204    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-var-lib-kubelet\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67af6855-5931-4939-9bcf-c8b5d4f720c7-var-lib-kubelet\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50c2c491-0a3d-46df-8992-e3360667a5a3-system-cni-dir\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564263    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-host-run-netns\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564313    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50c2c491-0a3d-46df-8992-e3360667a5a3-system-cni-dir\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-run-multus-certs\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564404    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e7c9701-d078-40ac-8c5d-862e417b0f9d-multus-daemon-config\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-kubelet-config\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-run-openvswitch\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-run-ovn\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564558    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-run-multus-certs\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-ovnkube-config\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-run-openvswitch\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.565004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564645    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-tuned\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.565880 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-kubelet-config\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:17.565880 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhbg\" (UniqueName: \"kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg\") pod \"network-check-target-4g72n\" (UID: \"ab9864ff-802f-4b23-baf5-e15e761ff147\") " pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:17.565880 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564796    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-var-lib-cni-multus\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.565880 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.564852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-ovn-node-metrics-cert\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.565880 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.565273    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-run-ovn\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.565880 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:17.565337    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:17.565880 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.565370    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e7c9701-d078-40ac-8c5d-862e417b0f9d-host-var-lib-cni-multus\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.565880 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:17.565444    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret podName:adb715a1-fa72-4b85-b1b1-1a2ddfebac5d nodeName:}" failed. No retries permitted until 2026-07-10 21:21:18.065420053 +0000 UTC m=+3.698665300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret") pod "global-pull-secret-syncer-279g5" (UID: "adb715a1-fa72-4b85-b1b1-1a2ddfebac5d") : object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:17.566477 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.566453    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-ovnkube-config\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.567308 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.567282    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67af6855-5931-4939-9bcf-c8b5d4f720c7-etc-tuned\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.569687 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.569662    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9x9c\" (UniqueName: \"kubernetes.io/projected/7d58d1e4-af64-4f0c-972e-a2e02bc12421-kube-api-access-c9x9c\") pod \"node-ca-4xzxz\" (UID: \"7d58d1e4-af64-4f0c-972e-a2e02bc12421\") " pod="openshift-image-registry/node-ca-4xzxz"
Jul 10 21:21:17.569807 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.569764    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vdjd\" (UniqueName: \"kubernetes.io/projected/67af6855-5931-4939-9bcf-c8b5d4f720c7-kube-api-access-5vdjd\") pod \"tuned-ktwkl\" (UID: \"67af6855-5931-4939-9bcf-c8b5d4f720c7\") " pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.570486 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.570389    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vh4f\" (UniqueName: \"kubernetes.io/projected/b32158dd-b7a4-435f-9a10-09ff04e5dcbf-kube-api-access-8vh4f\") pod \"aws-ebs-csi-driver-node-9hx4r\" (UID: \"b32158dd-b7a4-435f-9a10-09ff04e5dcbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.571231 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.571205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-ovn-node-metrics-cert\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.573009 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.572986    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh677\" (UniqueName: \"kubernetes.io/projected/82b782ff-c8bb-4f58-8d39-a59e7e9ae289-kube-api-access-wh677\") pod \"iptables-alerter-kvq7g\" (UID: \"82b782ff-c8bb-4f58-8d39-a59e7e9ae289\") " pod="openshift-network-operator/iptables-alerter-kvq7g"
Jul 10 21:21:17.573940 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.573916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rrpv\" (UniqueName: \"kubernetes.io/projected/0e7c9701-d078-40ac-8c5d-862e417b0f9d-kube-api-access-9rrpv\") pod \"multus-fm8sc\" (UID: \"0e7c9701-d078-40ac-8c5d-862e417b0f9d\") " pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.574039 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.573921    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zpcp\" (UniqueName: \"kubernetes.io/projected/69a397c0-e18d-435c-b66e-3557a9bb5851-kube-api-access-9zpcp\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:17.574355 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:17.574306    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 21:21:17.574355 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:17.574330    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 21:21:17.574355 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:17.574345    2575 projected.go:196] Error preparing data for projected volume kube-api-access-lzhbg for pod openshift-network-diagnostics/network-check-target-4g72n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:17.574571 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:17.574409    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg podName:ab9864ff-802f-4b23-baf5-e15e761ff147 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:18.074388606 +0000 UTC m=+3.707633855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lzhbg" (UniqueName: "kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg") pod "network-check-target-4g72n" (UID: "ab9864ff-802f-4b23-baf5-e15e761ff147") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:17.574942 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.574919    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28dsq\" (UniqueName: \"kubernetes.io/projected/9240b000-df62-4dd5-8d6b-a3ca3e838b6d-kube-api-access-28dsq\") pod \"ovnkube-node-n9lqx\" (UID: \"9240b000-df62-4dd5-8d6b-a3ca3e838b6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.576381 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.576336    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz5qr\" (UniqueName: \"kubernetes.io/projected/50c2c491-0a3d-46df-8992-e3360667a5a3-kube-api-access-pz5qr\") pod \"multus-additional-cni-plugins-xvw4p\" (UID: \"50c2c491-0a3d-46df-8992-e3360667a5a3\") " pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.576700 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.576666    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbl27\" (UniqueName: \"kubernetes.io/projected/92b95e58-9d5d-4939-bb6e-c6b0c246546f-kube-api-access-hbl27\") pod \"node-resolver-vsh7h\" (UID: \"92b95e58-9d5d-4939-bb6e-c6b0c246546f\") " pod="openshift-dns/node-resolver-vsh7h"
Jul 10 21:21:17.657624 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.657584    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mn7bk"
Jul 10 21:21:17.673758 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.673722    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fm8sc"
Jul 10 21:21:17.684644 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.684606    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:17.692968 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.692886    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ktwkl"
Jul 10 21:21:17.700981 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.700950    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r"
Jul 10 21:21:17.708982 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.708956    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4xzxz"
Jul 10 21:21:17.718015 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.717991    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xvw4p"
Jul 10 21:21:17.726804 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.726778    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vsh7h"
Jul 10 21:21:17.735623 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:17.735601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kvq7g"
Jul 10 21:21:18.069378 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:18.069337    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:18.069591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:18.069405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:18.069591 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:18.069535    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:18.069591 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:18.069551    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:18.069732 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:18.069604    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs podName:69a397c0-e18d-435c-b66e-3557a9bb5851 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:19.069586378 +0000 UTC m=+4.702831620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs") pod "network-metrics-daemon-l8sdv" (UID: "69a397c0-e18d-435c-b66e-3557a9bb5851") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:18.069732 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:18.069625    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret podName:adb715a1-fa72-4b85-b1b1-1a2ddfebac5d nodeName:}" failed. No retries permitted until 2026-07-10 21:21:19.06961471 +0000 UTC m=+4.702859953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret") pod "global-pull-secret-syncer-279g5" (UID: "adb715a1-fa72-4b85-b1b1-1a2ddfebac5d") : object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:18.170079 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:18.170034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhbg\" (UniqueName: \"kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg\") pod \"network-check-target-4g72n\" (UID: \"ab9864ff-802f-4b23-baf5-e15e761ff147\") " pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:18.170321 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:18.170254    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 21:21:18.170321 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:18.170300    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 21:21:18.170321 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:18.170316    2575 projected.go:196] Error preparing data for projected volume kube-api-access-lzhbg for pod openshift-network-diagnostics/network-check-target-4g72n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:18.170496 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:18.170389    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg podName:ab9864ff-802f-4b23-baf5-e15e761ff147 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:19.170367364 +0000 UTC m=+4.803612598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzhbg" (UniqueName: "kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg") pod "network-check-target-4g72n" (UID: "ab9864ff-802f-4b23-baf5-e15e761ff147") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:18.428626 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:18.428521    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 21:16:17 +0000 UTC" deadline="2028-03-05 13:25:27.930110896 +0000 UTC"
Jul 10 21:21:18.428626 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:18.428565    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14488h4m9.501549952s"
Jul 10 21:21:18.517385 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:18.517335    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:18.517572 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:18.517505    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:18.782137 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:18.782026    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7c9701_d078_40ac_8c5d_862e417b0f9d.slice/crio-82455e3eba478f9f9a14c84478ac975baefcead90f1d1a96573f625d498dae51 WatchSource:0}: Error finding container 82455e3eba478f9f9a14c84478ac975baefcead90f1d1a96573f625d498dae51: Status 404 returned error can't find the container with id 82455e3eba478f9f9a14c84478ac975baefcead90f1d1a96573f625d498dae51
Jul 10 21:21:18.783087 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:18.783061    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9240b000_df62_4dd5_8d6b_a3ca3e838b6d.slice/crio-32bd9bb5562812c02d403dc967d40a79b5ebfdca7ea07d89444f95d048b60a78 WatchSource:0}: Error finding container 32bd9bb5562812c02d403dc967d40a79b5ebfdca7ea07d89444f95d048b60a78: Status 404 returned error can't find the container with id 32bd9bb5562812c02d403dc967d40a79b5ebfdca7ea07d89444f95d048b60a78
Jul 10 21:21:18.784060 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:18.783965    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b95e58_9d5d_4939_bb6e_c6b0c246546f.slice/crio-421ad810c08073242a37ed1747a33261a7feef293d88fb2ae597c5fd5ad0a571 WatchSource:0}: Error finding container 421ad810c08073242a37ed1747a33261a7feef293d88fb2ae597c5fd5ad0a571: Status 404 returned error can't find the container with id 421ad810c08073242a37ed1747a33261a7feef293d88fb2ae597c5fd5ad0a571
Jul 10 21:21:18.785862 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:18.785708    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d58d1e4_af64_4f0c_972e_a2e02bc12421.slice/crio-52d95b5c6ce8252799eed1200a6c453f18349e794f3de93cca335dfef0cb37dc WatchSource:0}: Error finding container 52d95b5c6ce8252799eed1200a6c453f18349e794f3de93cca335dfef0cb37dc: Status 404 returned error can't find the container with id 52d95b5c6ce8252799eed1200a6c453f18349e794f3de93cca335dfef0cb37dc
Jul 10 21:21:18.789389 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:18.789362    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67af6855_5931_4939_9bcf_c8b5d4f720c7.slice/crio-3161ca1a6481aa5e9dd38a77d630f49c83873b7502d934bf2042341ad4513a4f WatchSource:0}: Error finding container 3161ca1a6481aa5e9dd38a77d630f49c83873b7502d934bf2042341ad4513a4f: Status 404 returned error can't find the container with id 3161ca1a6481aa5e9dd38a77d630f49c83873b7502d934bf2042341ad4513a4f
Jul 10 21:21:18.790988 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:18.790950    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b782ff_c8bb_4f58_8d39_a59e7e9ae289.slice/crio-42116bf5509bb3c90bb2f427a53c274156ca26aa1a69bdaa35d6a81b4db0439a WatchSource:0}: Error finding container 42116bf5509bb3c90bb2f427a53c274156ca26aa1a69bdaa35d6a81b4db0439a: Status 404 returned error can't find the container with id 42116bf5509bb3c90bb2f427a53c274156ca26aa1a69bdaa35d6a81b4db0439a
Jul 10 21:21:18.792679 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:18.792644    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32158dd_b7a4_435f_9a10_09ff04e5dcbf.slice/crio-fdb62457a6bf4527dc516ecc97967300326048777982918ce59628be87bb4100 WatchSource:0}: Error finding container fdb62457a6bf4527dc516ecc97967300326048777982918ce59628be87bb4100: Status 404 returned error can't find the container with id fdb62457a6bf4527dc516ecc97967300326048777982918ce59628be87bb4100
Jul 10 21:21:18.794097 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:18.793578    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c2c491_0a3d_46df_8992_e3360667a5a3.slice/crio-5f54605b02e7580221b3a209ff3d6ce8d66d2ba6853f338d82a0c2e935a9c725 WatchSource:0}: Error finding container 5f54605b02e7580221b3a209ff3d6ce8d66d2ba6853f338d82a0c2e935a9c725: Status 404 returned error can't find the container with id 5f54605b02e7580221b3a209ff3d6ce8d66d2ba6853f338d82a0c2e935a9c725
Jul 10 21:21:18.795180 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:18.795158    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc397e828_d1fc_45f4_bd7e_23848f0e5ab6.slice/crio-78f1f25d98c832a20d34104dd3dfad47327be6b496009a832b80adfbbe90efcd WatchSource:0}: Error finding container 78f1f25d98c832a20d34104dd3dfad47327be6b496009a832b80adfbbe90efcd: Status 404 returned error can't find the container with id 78f1f25d98c832a20d34104dd3dfad47327be6b496009a832b80adfbbe90efcd
Jul 10 21:21:19.078692 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.078484    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:19.078854 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.078724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:19.078854 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:19.078654    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:19.078854 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:19.078830    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:19.079002 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:19.078863    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret podName:adb715a1-fa72-4b85-b1b1-1a2ddfebac5d nodeName:}" failed. No retries permitted until 2026-07-10 21:21:21.078824509 +0000 UTC m=+6.712069765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret") pod "global-pull-secret-syncer-279g5" (UID: "adb715a1-fa72-4b85-b1b1-1a2ddfebac5d") : object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:19.079002 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:19.078897    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs podName:69a397c0-e18d-435c-b66e-3557a9bb5851 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:21.078884429 +0000 UTC m=+6.712129671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs") pod "network-metrics-daemon-l8sdv" (UID: "69a397c0-e18d-435c-b66e-3557a9bb5851") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:19.179867 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.179825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhbg\" (UniqueName: \"kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg\") pod \"network-check-target-4g72n\" (UID: \"ab9864ff-802f-4b23-baf5-e15e761ff147\") " pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:19.180048 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:19.180032    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 21:21:19.180114 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:19.180055    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 21:21:19.180114 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:19.180070    2575 projected.go:196] Error preparing data for projected volume kube-api-access-lzhbg for pod openshift-network-diagnostics/network-check-target-4g72n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:19.180225 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:19.180126    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg podName:ab9864ff-802f-4b23-baf5-e15e761ff147 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:21.180109171 +0000 UTC m=+6.813354405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzhbg" (UniqueName: "kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg") pod "network-check-target-4g72n" (UID: "ab9864ff-802f-4b23-baf5-e15e761ff147") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:19.429308 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.429161    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 21:16:17 +0000 UTC" deadline="2028-01-08 00:14:47.526830814 +0000 UTC"
Jul 10 21:21:19.429308 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.429238    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13106h53m28.097596547s"
Jul 10 21:21:19.520235 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.519242    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:19.520235 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:19.519393    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:19.520235 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.519800    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:19.520235 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:19.519906    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:19.531077 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.530978    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx" event={"ID":"9240b000-df62-4dd5-8d6b-a3ca3e838b6d","Type":"ContainerStarted","Data":"32bd9bb5562812c02d403dc967d40a79b5ebfdca7ea07d89444f95d048b60a78"}
Jul 10 21:21:19.536730 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.536646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fm8sc" event={"ID":"0e7c9701-d078-40ac-8c5d-862e417b0f9d","Type":"ContainerStarted","Data":"82455e3eba478f9f9a14c84478ac975baefcead90f1d1a96573f625d498dae51"}
Jul 10 21:21:19.543643 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.543610    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal" event={"ID":"ee9ba87a95626305bc9fc31aaeb61c99","Type":"ContainerStarted","Data":"263a23eb88b4dc7797406b027c135869903d5fc492c4c9817606e4efb3dd900c"}
Jul 10 21:21:19.549653 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.549618    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mn7bk" event={"ID":"c397e828-d1fc-45f4-bd7e-23848f0e5ab6","Type":"ContainerStarted","Data":"78f1f25d98c832a20d34104dd3dfad47327be6b496009a832b80adfbbe90efcd"}
Jul 10 21:21:19.555704 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.555670    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kvq7g" event={"ID":"82b782ff-c8bb-4f58-8d39-a59e7e9ae289","Type":"ContainerStarted","Data":"42116bf5509bb3c90bb2f427a53c274156ca26aa1a69bdaa35d6a81b4db0439a"}
Jul 10 21:21:19.558882 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.558823    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ktwkl" event={"ID":"67af6855-5931-4939-9bcf-c8b5d4f720c7","Type":"ContainerStarted","Data":"3161ca1a6481aa5e9dd38a77d630f49c83873b7502d934bf2042341ad4513a4f"}
Jul 10 21:21:19.565368 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.565299    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4xzxz" event={"ID":"7d58d1e4-af64-4f0c-972e-a2e02bc12421","Type":"ContainerStarted","Data":"52d95b5c6ce8252799eed1200a6c453f18349e794f3de93cca335dfef0cb37dc"}
Jul 10 21:21:19.571261 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.571230    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vsh7h" event={"ID":"92b95e58-9d5d-4939-bb6e-c6b0c246546f","Type":"ContainerStarted","Data":"421ad810c08073242a37ed1747a33261a7feef293d88fb2ae597c5fd5ad0a571"}
Jul 10 21:21:19.576075 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.576042    2575 generic.go:356] "Generic (PLEG): container finished" podID="ecc83a09f011f0ef47edc46335385adf" containerID="69b32ff2092753d9eed2f6ec0597107248b0dffd87cd5c5751fae9471c8de347" exitCode=0
Jul 10 21:21:19.576194 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.576140    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" event={"ID":"ecc83a09f011f0ef47edc46335385adf","Type":"ContainerDied","Data":"69b32ff2092753d9eed2f6ec0597107248b0dffd87cd5c5751fae9471c8de347"}
Jul 10 21:21:19.583675 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.583642    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvw4p" event={"ID":"50c2c491-0a3d-46df-8992-e3360667a5a3","Type":"ContainerStarted","Data":"5f54605b02e7580221b3a209ff3d6ce8d66d2ba6853f338d82a0c2e935a9c725"}
Jul 10 21:21:19.587429 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.587342    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r" event={"ID":"b32158dd-b7a4-435f-9a10-09ff04e5dcbf","Type":"ContainerStarted","Data":"fdb62457a6bf4527dc516ecc97967300326048777982918ce59628be87bb4100"}
Jul 10 21:21:19.596828 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:19.596766    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal" podStartSLOduration=2.596742689 podStartE2EDuration="2.596742689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:19.561763426 +0000 UTC m=+5.195008685" watchObservedRunningTime="2026-07-10 21:21:19.596742689 +0000 UTC m=+5.229987951"
Jul 10 21:21:20.517217 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:20.517164    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:20.517750 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:20.517332    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:20.622016 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:20.621979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" event={"ID":"ecc83a09f011f0ef47edc46335385adf","Type":"ContainerStarted","Data":"a096484e954b46954ce6f9102644cbf326fc1260624f6fd4c2577c09bf32a15d"}
Jul 10 21:21:20.641208 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:20.640780    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" podStartSLOduration=3.6407522390000002 podStartE2EDuration="3.640752239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:20.639887493 +0000 UTC m=+6.273132751" watchObservedRunningTime="2026-07-10 21:21:20.640752239 +0000 UTC m=+6.273997498"
Jul 10 21:21:21.100051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:21.099913    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:21.100051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:21.099997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:21.100317 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:21.100167    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:21.100317 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:21.100232    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs podName:69a397c0-e18d-435c-b66e-3557a9bb5851 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:25.100212937 +0000 UTC m=+10.733458173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs") pod "network-metrics-daemon-l8sdv" (UID: "69a397c0-e18d-435c-b66e-3557a9bb5851") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:21.100719 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:21.100663    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:21.100719 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:21.100720    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret podName:adb715a1-fa72-4b85-b1b1-1a2ddfebac5d nodeName:}" failed. No retries permitted until 2026-07-10 21:21:25.10070412 +0000 UTC m=+10.733949356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret") pod "global-pull-secret-syncer-279g5" (UID: "adb715a1-fa72-4b85-b1b1-1a2ddfebac5d") : object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:21.202098 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:21.201382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhbg\" (UniqueName: \"kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg\") pod \"network-check-target-4g72n\" (UID: \"ab9864ff-802f-4b23-baf5-e15e761ff147\") " pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:21.202098 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:21.201629    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 21:21:21.202098 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:21.201658    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 21:21:21.202098 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:21.201672    2575 projected.go:196] Error preparing data for projected volume kube-api-access-lzhbg for pod openshift-network-diagnostics/network-check-target-4g72n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:21.202098 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:21.201737    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg podName:ab9864ff-802f-4b23-baf5-e15e761ff147 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:25.201716812 +0000 UTC m=+10.834962060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzhbg" (UniqueName: "kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg") pod "network-check-target-4g72n" (UID: "ab9864ff-802f-4b23-baf5-e15e761ff147") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:21.518239 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:21.517433    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:21.518239 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:21.517454    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:21.518239 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:21.517592    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:21.518239 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:21.518063    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:22.517576 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:22.517199    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:22.517576 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:22.517355    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:23.517947 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:23.517916    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:23.518449 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:23.518046    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:23.518647 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:23.518628    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:23.518765 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:23.518742    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:24.517757 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:24.517721    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:24.517942 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:24.517857    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:25.136521 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:25.136475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:25.136924 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:25.136550    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:25.136924 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:25.136645    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:25.136924 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:25.136674    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:25.136924 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:25.136728    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret podName:adb715a1-fa72-4b85-b1b1-1a2ddfebac5d nodeName:}" failed. No retries permitted until 2026-07-10 21:21:33.136708573 +0000 UTC m=+18.769953824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret") pod "global-pull-secret-syncer-279g5" (UID: "adb715a1-fa72-4b85-b1b1-1a2ddfebac5d") : object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:25.136924 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:25.136750    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs podName:69a397c0-e18d-435c-b66e-3557a9bb5851 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:33.136739852 +0000 UTC m=+18.769985097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs") pod "network-metrics-daemon-l8sdv" (UID: "69a397c0-e18d-435c-b66e-3557a9bb5851") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:25.237524 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:25.237401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhbg\" (UniqueName: \"kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg\") pod \"network-check-target-4g72n\" (UID: \"ab9864ff-802f-4b23-baf5-e15e761ff147\") " pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:25.237679 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:25.237598    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 21:21:25.237679 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:25.237626    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 21:21:25.237679 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:25.237639    2575 projected.go:196] Error preparing data for projected volume kube-api-access-lzhbg for pod openshift-network-diagnostics/network-check-target-4g72n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:25.237810 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:25.237704    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg podName:ab9864ff-802f-4b23-baf5-e15e761ff147 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:33.237685236 +0000 UTC m=+18.870930486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzhbg" (UniqueName: "kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg") pod "network-check-target-4g72n" (UID: "ab9864ff-802f-4b23-baf5-e15e761ff147") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:25.519198 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:25.519115    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:25.519198 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:25.519162    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:25.519457 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:25.519247    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:25.519564 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:25.519520    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:26.517463 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:26.517377    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:26.517939 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:26.517508    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:27.517695 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:27.517489    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:27.517695 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:27.517635    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:27.518231 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:27.518180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:27.518347 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:27.518313    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:28.518154 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:28.517658    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:28.518154 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:28.517800    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:29.517356 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:29.517237    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:29.517511 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:29.517394    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:29.517511 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:29.517454    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:29.517603 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:29.517533    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:30.516860 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:30.516823    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:30.517287 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:30.516943    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:31.517624 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:31.517587    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:31.517624 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:31.517610    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:31.518116 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:31.517732    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:31.518116 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:31.517867    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:32.517443 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:32.517413    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:32.517626 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:32.517530    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:33.201418 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:33.201329    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:33.201807 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:33.201488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:33.201807 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:33.201516    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:33.201807 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:33.201590    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:33.201807 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:33.201592    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs podName:69a397c0-e18d-435c-b66e-3557a9bb5851 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:49.201570622 +0000 UTC m=+34.834815871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs") pod "network-metrics-daemon-l8sdv" (UID: "69a397c0-e18d-435c-b66e-3557a9bb5851") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:33.201807 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:33.201651    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret podName:adb715a1-fa72-4b85-b1b1-1a2ddfebac5d nodeName:}" failed. No retries permitted until 2026-07-10 21:21:49.201633781 +0000 UTC m=+34.834879014 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret") pod "global-pull-secret-syncer-279g5" (UID: "adb715a1-fa72-4b85-b1b1-1a2ddfebac5d") : object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:33.302154 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:33.302114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhbg\" (UniqueName: \"kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg\") pod \"network-check-target-4g72n\" (UID: \"ab9864ff-802f-4b23-baf5-e15e761ff147\") " pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:33.302353 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:33.302313    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 21:21:33.302353 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:33.302345    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 21:21:33.302452 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:33.302357    2575 projected.go:196] Error preparing data for projected volume kube-api-access-lzhbg for pod openshift-network-diagnostics/network-check-target-4g72n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:33.302452 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:33.302421    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg podName:ab9864ff-802f-4b23-baf5-e15e761ff147 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:49.30240697 +0000 UTC m=+34.935652202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzhbg" (UniqueName: "kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg") pod "network-check-target-4g72n" (UID: "ab9864ff-802f-4b23-baf5-e15e761ff147") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:33.517053 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:33.516970    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:33.517213 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:33.517112    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:33.517213 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:33.517197    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:33.517359 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:33.517311    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:34.517510 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:34.517477    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:34.517908 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:34.517602    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:35.518419 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:35.518354    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:35.518857 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:35.518438    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:35.518857 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:35.518459    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:35.518857 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:35.518542    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:36.517607 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:36.517573    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:36.517783 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:36.517697    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:37.517867 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:37.517838    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:37.518260 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:37.517848    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:37.518260 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:37.517985    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:37.518260 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:37.518060    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:37.668707 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:37.668478    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mn7bk" event={"ID":"c397e828-d1fc-45f4-bd7e-23848f0e5ab6","Type":"ContainerStarted","Data":"ccc8ccf044111f01dc2b7852fa35d81abfeb779e493af992bd867e6046f65300"}
Jul 10 21:21:37.687930 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:37.687858    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mn7bk" podStartSLOduration=7.619601661 podStartE2EDuration="21.687838645s" totalImagesPullingTime="14.068236984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:37.68754421 +0000 UTC m=+23.320789466" watchObservedRunningTime="2026-07-10 21:21:37.687838645 +0000 UTC m=+23.321083906"
Jul 10 21:21:37.719916 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:37.719621    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mn7bk"
Jul 10 21:21:37.720557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:37.720529    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mn7bk"
Jul 10 21:21:38.517173 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.516957    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:38.517343 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:38.517218    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:38.674865 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.674822    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ktwkl" event={"ID":"67af6855-5931-4939-9bcf-c8b5d4f720c7","Type":"ContainerStarted","Data":"e1cb892dd1bf9e3fb48dd979559347f1f5cb0b0d4ec0bc76d17cd8cf0ea08fd8"}
Jul 10 21:21:38.676332 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.676305    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4xzxz" event={"ID":"7d58d1e4-af64-4f0c-972e-a2e02bc12421","Type":"ContainerStarted","Data":"322ffca1c73e1e0079fbe33093c21751c4ae66c6d4d74fea2de132f7bb4e9921"}
Jul 10 21:21:38.677900 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.677877    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vsh7h" event={"ID":"92b95e58-9d5d-4939-bb6e-c6b0c246546f","Type":"ContainerStarted","Data":"21fb1660c30b2028b36c176b31f421c43a7a7237c11a6d98188cb7e2e459b52e"}
Jul 10 21:21:38.679585 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.679556    2575 generic.go:356] "Generic (PLEG): container finished" podID="50c2c491-0a3d-46df-8992-e3360667a5a3" containerID="e81f01c49b817e6a522635ff3a6aa0c6e3d90ee10ef7ee79379e172626773b67" exitCode=0
Jul 10 21:21:38.679692 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.679596    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvw4p" event={"ID":"50c2c491-0a3d-46df-8992-e3360667a5a3","Type":"ContainerDied","Data":"e81f01c49b817e6a522635ff3a6aa0c6e3d90ee10ef7ee79379e172626773b67"}
Jul 10 21:21:38.681677 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.681654    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r" event={"ID":"b32158dd-b7a4-435f-9a10-09ff04e5dcbf","Type":"ContainerStarted","Data":"eefd59d8875605401ee8a2f863c88992f949208ae7776bcd9b69fe597a1d4450"}
Jul 10 21:21:38.684599 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.684582    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:21:38.685705 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.685186    2575 generic.go:356] "Generic (PLEG): container finished" podID="9240b000-df62-4dd5-8d6b-a3ca3e838b6d" containerID="f6e9cfc41eba3b84fe1f4aa14bb7706ef95b8bb17fe00a692b021520aaaaa93e" exitCode=1
Jul 10 21:21:38.685705 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.685260    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx" event={"ID":"9240b000-df62-4dd5-8d6b-a3ca3e838b6d","Type":"ContainerStarted","Data":"57996839e1d04edde7c8c21e737101a716e931dae285f01b7856bfe1759b8e92"}
Jul 10 21:21:38.685705 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.685339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx" event={"ID":"9240b000-df62-4dd5-8d6b-a3ca3e838b6d","Type":"ContainerStarted","Data":"1e6f6499ed40d3cf513b272ac22b3d1a9eb8f6c57dec7ced5943c1595a5030f1"}
Jul 10 21:21:38.685705 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.685383    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx" event={"ID":"9240b000-df62-4dd5-8d6b-a3ca3e838b6d","Type":"ContainerStarted","Data":"6fdd4f32ab876bdd8ac79b6b5fd9508803c8a44d3218672d4a2ed18b7ed494b1"}
Jul 10 21:21:38.685705 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.685425    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx" event={"ID":"9240b000-df62-4dd5-8d6b-a3ca3e838b6d","Type":"ContainerStarted","Data":"537ca8c946cad8d94fba65505cad52aabe531100751bfead70824b80eabdfefd"}
Jul 10 21:21:38.685705 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.685467    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx" event={"ID":"9240b000-df62-4dd5-8d6b-a3ca3e838b6d","Type":"ContainerDied","Data":"f6e9cfc41eba3b84fe1f4aa14bb7706ef95b8bb17fe00a692b021520aaaaa93e"}
Jul 10 21:21:38.685705 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.685511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx" event={"ID":"9240b000-df62-4dd5-8d6b-a3ca3e838b6d","Type":"ContainerStarted","Data":"926e0e004a4060cc7a1fef09a092947ceb28e89250725364e899aa19e83e78b1"}
Jul 10 21:21:38.688768 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.688709    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fm8sc" event={"ID":"0e7c9701-d078-40ac-8c5d-862e417b0f9d","Type":"ContainerStarted","Data":"c8a34bf1c84911b75d9236710b7d236cf825a48747609dea590e37c35a46f7b0"}
Jul 10 21:21:38.689004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.688986    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 21:21:38.694692 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.694654    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ktwkl" podStartSLOduration=3.983654579 podStartE2EDuration="22.694641574s" totalImagesPullingTime="18.710986995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:38.694066487 +0000 UTC m=+24.327311736" watchObservedRunningTime="2026-07-10 21:21:38.694641574 +0000 UTC m=+24.327886828"
Jul 10 21:21:38.711327 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.711249    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vsh7h" podStartSLOduration=4.008239147 podStartE2EDuration="22.711234052s" totalImagesPullingTime="18.702994905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:38.711179088 +0000 UTC m=+24.344424335" watchObservedRunningTime="2026-07-10 21:21:38.711234052 +0000 UTC m=+24.344479306"
Jul 10 21:21:38.730882 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.730832    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fm8sc" podStartSLOduration=4.010986382 podStartE2EDuration="22.730800574s" totalImagesPullingTime="18.719814192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:38.730701733 +0000 UTC m=+24.363946984" watchObservedRunningTime="2026-07-10 21:21:38.730800574 +0000 UTC m=+24.364045828"
Jul 10 21:21:38.750598 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.750517    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4xzxz" podStartSLOduration=4.049229605 podStartE2EDuration="22.750501787s" totalImagesPullingTime="18.701272182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:38.749597983 +0000 UTC m=+24.382843237" watchObservedRunningTime="2026-07-10 21:21:38.750501787 +0000 UTC m=+24.383747040"
Jul 10 21:21:38.890063 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.890031    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:38.970169 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:38.970141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:39.089116 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.089079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:39.183131 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.183048    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:39.288402 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.288363    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:39.383916 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.383884    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:39.420988 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.420887    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T21:21:38.689002605Z","UUID":"37c3c35a-dde6-495c-b86d-e6f0a0e6915b","Handler":null,"Name":"","Endpoint":""}
Jul 10 21:21:39.422612 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.422589    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 21:21:39.422748 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.422635    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 21:21:39.517556 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.517465    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:39.517556 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.517509    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:39.517767 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:39.517611    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:39.517767 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:39.517732    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:39.693243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.693204    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kvq7g" event={"ID":"82b782ff-c8bb-4f58-8d39-a59e7e9ae289","Type":"ContainerStarted","Data":"2fab99ec70487a697be66dcc5c0ffceca2b1e28c276ad792a2c889d378d1105f"}
Jul 10 21:21:39.695099 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.695071    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r" event={"ID":"b32158dd-b7a4-435f-9a10-09ff04e5dcbf","Type":"ContainerStarted","Data":"2ff4fd672f392b10f75b032900fa8dd24dd4da64f194394b5c57f27ab12163f2"}
Jul 10 21:21:39.695438 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.695422    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 10 21:21:39.709523 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:39.709475    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kvq7g" podStartSLOduration=5.013491465 podStartE2EDuration="23.709458969s" totalImagesPullingTime="18.695967504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:39.709309145 +0000 UTC m=+25.342554399" watchObservedRunningTime="2026-07-10 21:21:39.709458969 +0000 UTC m=+25.342704223"
Jul 10 21:21:40.135829 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:40.135795    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:40.517960 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:40.517774    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:40.518112 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:40.518051    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:40.531117 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:40.531085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:40.597554 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:40.597521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:40.699726 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:40.699632    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r" event={"ID":"b32158dd-b7a4-435f-9a10-09ff04e5dcbf","Type":"ContainerStarted","Data":"ebc1daeeb9dd8fd1445f5cc1d1ff48128cf88d9f276ed5f8069b12756e171ea4"}
Jul 10 21:21:40.703083 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:40.703061    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:21:40.703658 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:40.703523    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx" event={"ID":"9240b000-df62-4dd5-8d6b-a3ca3e838b6d","Type":"ContainerStarted","Data":"4f1838e7adb3039057476623f0fa1a9f626b05c143f42ff3848ad3354956d1ce"}
Jul 10 21:21:40.708150 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:40.708122    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mn7bk"
Jul 10 21:21:40.708288 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:40.708217    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 10 21:21:40.708683 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:40.708660    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mn7bk"
Jul 10 21:21:40.721605 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:40.721543    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hx4r" podStartSLOduration=4.071228382 podStartE2EDuration="24.721522396s" totalImagesPullingTime="20.650294014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:40.719694362 +0000 UTC m=+26.352939627" watchObservedRunningTime="2026-07-10 21:21:40.721522396 +0000 UTC m=+26.354767707"
Jul 10 21:21:40.827694 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:40.827661    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:41.327843 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:41.327809    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:41.504804 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:41.504762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:41.517760 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:41.517736    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:41.517891 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:41.517839    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:41.517891 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:41.517869    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:41.517969 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:41.517915    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:41.606073 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:41.606044    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:41.719145 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:41.719111    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:41.781353 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:41.781323    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:42.089990 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:42.089959    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:42.502511 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:42.502426    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:42.517374 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:42.517345    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:42.517529 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:42.517441    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:42.767077 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:42.767001    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:42.824973 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:42.824938    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:43.517511 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:43.517322    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:43.517673 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:43.517335    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:43.517673 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:43.517590    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:43.517763 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:43.517696    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:43.711816 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:43.711784    2575 generic.go:356] "Generic (PLEG): container finished" podID="50c2c491-0a3d-46df-8992-e3360667a5a3" containerID="83239597703d08c02c57b21c97ae9783ea5ff4743d44daf8c9f9003a8fba4a0a" exitCode=0
Jul 10 21:21:43.712038 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:43.711871    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvw4p" event={"ID":"50c2c491-0a3d-46df-8992-e3360667a5a3","Type":"ContainerDied","Data":"83239597703d08c02c57b21c97ae9783ea5ff4743d44daf8c9f9003a8fba4a0a"}
Jul 10 21:21:43.715309 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:43.715290    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:21:43.715635 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:43.715614    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx" event={"ID":"9240b000-df62-4dd5-8d6b-a3ca3e838b6d","Type":"ContainerStarted","Data":"6e79a548084bf39df4cc57ff5b857027a5e5460fdef02bab91065b1e175ac85e"}
Jul 10 21:21:43.715852 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:43.715840    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:43.715993 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:43.715977    2575 scope.go:117] "RemoveContainer" containerID="f6e9cfc41eba3b84fe1f4aa14bb7706ef95b8bb17fe00a692b021520aaaaa93e"
Jul 10 21:21:43.731463 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:43.731442    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:44.517316 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:44.517285    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:44.517823 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:44.517391    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:44.720404 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:44.720313    2575 generic.go:356] "Generic (PLEG): container finished" podID="50c2c491-0a3d-46df-8992-e3360667a5a3" containerID="536038a19775283c53048f8948ef98d96ee16a249950b0ed193c5e2460ca585b" exitCode=0
Jul 10 21:21:44.720404 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:44.720389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvw4p" event={"ID":"50c2c491-0a3d-46df-8992-e3360667a5a3","Type":"ContainerDied","Data":"536038a19775283c53048f8948ef98d96ee16a249950b0ed193c5e2460ca585b"}
Jul 10 21:21:44.724910 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:44.724891    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:21:44.725331 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:44.725295    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx" event={"ID":"9240b000-df62-4dd5-8d6b-a3ca3e838b6d","Type":"ContainerStarted","Data":"63a34016bd61071dba06f0539995465cb30989e0867c8ad12aff1313ac83329b"}
Jul 10 21:21:44.725422 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:44.725381    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 10 21:21:44.725660 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:44.725637    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:44.740935 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:44.740906    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:44.772157 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:44.772107    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx" podStartSLOduration=9.974749308 podStartE2EDuration="28.772093198s" totalImagesPullingTime="18.79734389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:44.770515597 +0000 UTC m=+30.403760852" watchObservedRunningTime="2026-07-10 21:21:44.772093198 +0000 UTC m=+30.405338484"
Jul 10 21:21:45.080297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:45.080231    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-279g5"]
Jul 10 21:21:45.080457 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:45.080444    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:45.080583 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:45.080557    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:45.080862 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:45.080844    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4g72n"]
Jul 10 21:21:45.080933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:45.080921    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:45.081015 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:45.080999    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:45.082491 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:45.082467    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l8sdv"]
Jul 10 21:21:45.082596 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:45.082563    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:45.082660 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:45.082643    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:45.590980 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:45.590806    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:21:45.729477 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:45.729395    2575 generic.go:356] "Generic (PLEG): container finished" podID="50c2c491-0a3d-46df-8992-e3360667a5a3" containerID="e47f16b62195d7da11047bd03b04d5e014db5cc0c224132c745f2da358e7f776" exitCode=0
Jul 10 21:21:45.729614 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:45.729482    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvw4p" event={"ID":"50c2c491-0a3d-46df-8992-e3360667a5a3","Type":"ContainerDied","Data":"e47f16b62195d7da11047bd03b04d5e014db5cc0c224132c745f2da358e7f776"}
Jul 10 21:21:46.516906 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:46.516870    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:46.516906 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:46.516908    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:46.517124 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:46.517041    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:46.517124 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:46.517084    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:46.517221 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:46.517147    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:46.517266 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:46.517223    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:47.737930 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:47.737896    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:47.842461 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:47.842426    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:48.194247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:48.194202    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:48.281830 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:48.281788    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:48.517234 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:48.517146    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:48.517398 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:48.517170    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:48.517398 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:48.517294    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:48.517398 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:48.517287    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-279g5" podUID="adb715a1-fa72-4b85-b1b1-1a2ddfebac5d"
Jul 10 21:21:48.517398 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:48.517362    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8sdv" podUID="69a397c0-e18d-435c-b66e-3557a9bb5851"
Jul 10 21:21:48.517539 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:48.517447    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g72n" podUID="ab9864ff-802f-4b23-baf5-e15e761ff147"
Jul 10 21:21:48.896835 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:48.896804    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:48.996592 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:48.996519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:49.153736 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:49.153656    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:49.226734 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:49.226696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:49.226912 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:49.226770    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:49.226912 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:49.226871    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:49.227008 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:49.226930    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret podName:adb715a1-fa72-4b85-b1b1-1a2ddfebac5d nodeName:}" failed. No retries permitted until 2026-07-10 21:22:21.226916956 +0000 UTC m=+66.860162188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret") pod "global-pull-secret-syncer-279g5" (UID: "adb715a1-fa72-4b85-b1b1-1a2ddfebac5d") : object "kube-system"/"original-pull-secret" not registered
Jul 10 21:21:49.227008 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:49.226872    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:49.227008 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:49.227005    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs podName:69a397c0-e18d-435c-b66e-3557a9bb5851 nodeName:}" failed. No retries permitted until 2026-07-10 21:22:21.226989917 +0000 UTC m=+66.860235153 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs") pod "network-metrics-daemon-l8sdv" (UID: "69a397c0-e18d-435c-b66e-3557a9bb5851") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 21:21:49.252417 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:49.252384    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:49.327778 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:49.327737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhbg\" (UniqueName: \"kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg\") pod \"network-check-target-4g72n\" (UID: \"ab9864ff-802f-4b23-baf5-e15e761ff147\") " pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:49.327940 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:49.327926    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 21:21:49.328015 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:49.327949    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 21:21:49.328015 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:49.327959    2575 projected.go:196] Error preparing data for projected volume kube-api-access-lzhbg for pod openshift-network-diagnostics/network-check-target-4g72n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:49.328108 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:49.328017    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg podName:ab9864ff-802f-4b23-baf5-e15e761ff147 nodeName:}" failed. No retries permitted until 2026-07-10 21:22:21.327998414 +0000 UTC m=+66.961243665 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzhbg" (UniqueName: "kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg") pod "network-check-target-4g72n" (UID: "ab9864ff-802f-4b23-baf5-e15e761ff147") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 21:21:49.353100 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:49.353066    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:49.629901 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:49.629868    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:49.733120 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:49.733090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:49.832691 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:49.832646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:50.148242 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.148220    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeReady"
Jul 10 21:21:50.148685 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.148367    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 21:21:50.186427 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.186398    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-548b95f5c9-vlqqd"]
Jul 10 21:21:50.197877 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.197844    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.202148 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.202077    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lkx9k\""
Jul 10 21:21:50.202333 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.202077    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 21:21:50.202443 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.202420    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-44hf6"]
Jul 10 21:21:50.202443 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.202433    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 21:21:50.202778 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.202761    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 21:21:50.212028 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.212001    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tc6m7"]
Jul 10 21:21:50.212243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.212102    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 21:21:50.212243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.212135    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.215259 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.215243    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hw29l\""
Jul 10 21:21:50.215550 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.215534    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 21:21:50.215606 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.215568    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 21:21:50.224317 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.224292    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-548b95f5c9-vlqqd"]
Jul 10 21:21:50.224481 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.224346    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tc6m7"]
Jul 10 21:21:50.224595 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.224435    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tc6m7"
Jul 10 21:21:50.225562 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.225532    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-44hf6"]
Jul 10 21:21:50.227332 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.227304    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 21:21:50.227445 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.227320    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 21:21:50.227697 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.227680    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 21:21:50.227862 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.227847    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jkgdz\""
Jul 10 21:21:50.230035 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.230012    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k6wlt"]
Jul 10 21:21:50.240885 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.240862    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.243848 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.243826    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 21:21:50.244202 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.244012    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 21:21:50.244202 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.244038    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k6wlt"]
Jul 10 21:21:50.244202 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.244036    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 21:21:50.244202 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.244013    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f6m5r\""
Jul 10 21:21:50.244202 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.244119    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 21:21:50.334340 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbn54\" (UniqueName: \"kubernetes.io/projected/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-api-access-dbn54\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.334340 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334343    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfnj7\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-kube-api-access-rfnj7\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.334598 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-ca-trust-extracted\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.334598 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-bound-sa-token\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.334598 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334442    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e84fed44-e9d5-4f3e-bc43-d1df60683820-config-volume\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.334598 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppvxj\" (UniqueName: \"kubernetes.io/projected/4059fb8a-cf89-4590-93c4-4d817e332b86-kube-api-access-ppvxj\") pod \"ingress-canary-tc6m7\" (UID: \"4059fb8a-cf89-4590-93c4-4d817e332b86\") " pod="openshift-ingress-canary/ingress-canary-tc6m7"
Jul 10 21:21:50.334598 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-image-registry-private-configuration\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.334598 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334576    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-data-volume\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.334847 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334601    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.334847 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.334847 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-certificates\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.334847 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334695    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-trusted-ca\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.334847 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-installation-pull-secrets\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.334847 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334742    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4059fb8a-cf89-4590-93c4-4d817e332b86-cert\") pod \"ingress-canary-tc6m7\" (UID: \"4059fb8a-cf89-4590-93c4-4d817e332b86\") " pod="openshift-ingress-canary/ingress-canary-tc6m7"
Jul 10 21:21:50.334847 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.334847 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334821    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9xn7\" (UniqueName: \"kubernetes.io/projected/e84fed44-e9d5-4f3e-bc43-d1df60683820-kube-api-access-x9xn7\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.335121 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-crio-socket\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.335121 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e84fed44-e9d5-4f3e-bc43-d1df60683820-tmp-dir\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.335121 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.334909    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.367426 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.367350    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:50.435347 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.435328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.435422 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.435357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xn7\" (UniqueName: \"kubernetes.io/projected/e84fed44-e9d5-4f3e-bc43-d1df60683820-kube-api-access-x9xn7\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.435422 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.435383    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-crio-socket\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.435422 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.435412    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e84fed44-e9d5-4f3e-bc43-d1df60683820-tmp-dir\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.435581 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.435561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.435635 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.435578    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 21:21:50.435635 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.435597    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548b95f5c9-vlqqd: secret "image-registry-tls" not found
Jul 10 21:21:50.435635 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.435615    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 21:21:50.435635 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.435627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbn54\" (UniqueName: \"kubernetes.io/projected/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-api-access-dbn54\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.435780 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.435567    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-crio-socket\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.435780 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.435692    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e84fed44-e9d5-4f3e-bc43-d1df60683820-tmp-dir\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.436100 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.436008    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls podName:6b262f9e-6d68-4a6f-8d00-7259b67b14b4 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:50.935635056 +0000 UTC m=+36.568880307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls") pod "image-registry-548b95f5c9-vlqqd" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4") : secret "image-registry-tls" not found
Jul 10 21:21:50.436182 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.436140    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm podName:83b4c122-9bc3-4ff3-860b-4e94b8dda99a nodeName:}" failed. No retries permitted until 2026-07-10 21:21:50.936123393 +0000 UTC m=+36.569368633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k6wlt" (UID: "83b4c122-9bc3-4ff3-860b-4e94b8dda99a") : configmap "kube-rbac-proxy" not found
Jul 10 21:21:50.436225 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.436174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfnj7\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-kube-api-access-rfnj7\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.436225 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.436213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-ca-trust-extracted\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.436340 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.436246    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-bound-sa-token\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.436340 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.436296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e84fed44-e9d5-4f3e-bc43-d1df60683820-config-volume\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.436445 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.436354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppvxj\" (UniqueName: \"kubernetes.io/projected/4059fb8a-cf89-4590-93c4-4d817e332b86-kube-api-access-ppvxj\") pod \"ingress-canary-tc6m7\" (UID: \"4059fb8a-cf89-4590-93c4-4d817e332b86\") " pod="openshift-ingress-canary/ingress-canary-tc6m7"
Jul 10 21:21:50.436604 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.436578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-image-registry-private-configuration\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.436813 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.436791    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-ca-trust-extracted\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.436918 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.436899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e84fed44-e9d5-4f3e-bc43-d1df60683820-config-volume\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.436971 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.436916    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-data-volume\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.437025 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.436973    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.437025 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.437010    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.437167 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.437152    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 21:21:50.437239 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.437226    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls podName:e84fed44-e9d5-4f3e-bc43-d1df60683820 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:50.937203437 +0000 UTC m=+36.570448672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls") pod "dns-default-44hf6" (UID: "e84fed44-e9d5-4f3e-bc43-d1df60683820") : secret "dns-default-metrics-tls" not found
Jul 10 21:21:50.437329 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.437314    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-data-volume\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.437395 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.437376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-certificates\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.437442 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.437417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-trusted-ca\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.437484 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.437450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-installation-pull-secrets\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.437525 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.437480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4059fb8a-cf89-4590-93c4-4d817e332b86-cert\") pod \"ingress-canary-tc6m7\" (UID: \"4059fb8a-cf89-4590-93c4-4d817e332b86\") " pod="openshift-ingress-canary/ingress-canary-tc6m7"
Jul 10 21:21:50.437626 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.437610    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 21:21:50.437686 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.437676    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls podName:83b4c122-9bc3-4ff3-860b-4e94b8dda99a nodeName:}" failed. No retries permitted until 2026-07-10 21:21:50.937660126 +0000 UTC m=+36.570905365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k6wlt" (UID: "83b4c122-9bc3-4ff3-860b-4e94b8dda99a") : secret "insights-runtime-extractor-tls" not found
Jul 10 21:21:50.438311 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.438289    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-certificates\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.438901 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.438877    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-trusted-ca\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.442214 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.442182    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4059fb8a-cf89-4590-93c4-4d817e332b86-cert\") pod \"ingress-canary-tc6m7\" (UID: \"4059fb8a-cf89-4590-93c4-4d817e332b86\") " pod="openshift-ingress-canary/ingress-canary-tc6m7"
Jul 10 21:21:50.442472 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.442456    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-installation-pull-secrets\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.442993 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.442977    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-image-registry-private-configuration\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.458045 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.458016    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppvxj\" (UniqueName: \"kubernetes.io/projected/4059fb8a-cf89-4590-93c4-4d817e332b86-kube-api-access-ppvxj\") pod \"ingress-canary-tc6m7\" (UID: \"4059fb8a-cf89-4590-93c4-4d817e332b86\") " pod="openshift-ingress-canary/ingress-canary-tc6m7"
Jul 10 21:21:50.458466 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.458428    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbn54\" (UniqueName: \"kubernetes.io/projected/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-api-access-dbn54\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.458466 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.458447    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-bound-sa-token\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.458653 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.458451    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9xn7\" (UniqueName: \"kubernetes.io/projected/e84fed44-e9d5-4f3e-bc43-d1df60683820-kube-api-access-x9xn7\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.458716 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.458699    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfnj7\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-kube-api-access-rfnj7\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.463790 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.463759    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:50.490628 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.490460    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-9ktrg"]
Jul 10 21:21:50.511658 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.511633    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-9ktrg"]
Jul 10 21:21:50.511810 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.511726    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg"
Jul 10 21:21:50.514091 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.514068    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5w56n\""
Jul 10 21:21:50.514369 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.514352    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 10 21:21:50.514425 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.514396    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 10 21:21:50.514504 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.514486    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 10 21:21:50.514567 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.514511    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 10 21:21:50.516758 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.516740    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:21:50.516758 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.516754    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:21:50.516884 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.516819    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:21:50.535293 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.534492    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 21:21:50.535293 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.534786    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nklrg\""
Jul 10 21:21:50.535293 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.534962    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 21:21:50.535293 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.535164    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 21:21:50.535629 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.535379    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 21:21:50.535629 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.535591    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j44v2\""
Jul 10 21:21:50.540402 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.540182    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tc6m7"
Jul 10 21:21:50.542771 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.542747    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:50.641383 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.641342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj485\" (UniqueName: \"kubernetes.io/projected/3fa67b9f-8584-4a47-8af9-b1db2551f98c-kube-api-access-sj485\") pod \"service-ca-79f68b9f4f-9ktrg\" (UID: \"3fa67b9f-8584-4a47-8af9-b1db2551f98c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg"
Jul 10 21:21:50.641513 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.641464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3fa67b9f-8584-4a47-8af9-b1db2551f98c-signing-key\") pod \"service-ca-79f68b9f4f-9ktrg\" (UID: \"3fa67b9f-8584-4a47-8af9-b1db2551f98c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg"
Jul 10 21:21:50.641513 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.641486    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3fa67b9f-8584-4a47-8af9-b1db2551f98c-signing-cabundle\") pod \"service-ca-79f68b9f4f-9ktrg\" (UID: \"3fa67b9f-8584-4a47-8af9-b1db2551f98c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg"
Jul 10 21:21:50.727450 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.727420    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tc6m7"]
Jul 10 21:21:50.732628 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:50.732591    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4059fb8a_cf89_4590_93c4_4d817e332b86.slice/crio-c05c89035045d8a85328e843221d33fb1e23b14482b31b58d90eeb4066423ffe WatchSource:0}: Error finding container c05c89035045d8a85328e843221d33fb1e23b14482b31b58d90eeb4066423ffe: Status 404 returned error can't find the container with id c05c89035045d8a85328e843221d33fb1e23b14482b31b58d90eeb4066423ffe
Jul 10 21:21:50.742035 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.742016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj485\" (UniqueName: \"kubernetes.io/projected/3fa67b9f-8584-4a47-8af9-b1db2551f98c-kube-api-access-sj485\") pod \"service-ca-79f68b9f4f-9ktrg\" (UID: \"3fa67b9f-8584-4a47-8af9-b1db2551f98c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg"
Jul 10 21:21:50.742137 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.742102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3fa67b9f-8584-4a47-8af9-b1db2551f98c-signing-key\") pod \"service-ca-79f68b9f4f-9ktrg\" (UID: \"3fa67b9f-8584-4a47-8af9-b1db2551f98c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg"
Jul 10 21:21:50.742137 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.742128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3fa67b9f-8584-4a47-8af9-b1db2551f98c-signing-cabundle\") pod \"service-ca-79f68b9f4f-9ktrg\" (UID: \"3fa67b9f-8584-4a47-8af9-b1db2551f98c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg"
Jul 10 21:21:50.742955 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.742927    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3fa67b9f-8584-4a47-8af9-b1db2551f98c-signing-cabundle\") pod \"service-ca-79f68b9f4f-9ktrg\" (UID: \"3fa67b9f-8584-4a47-8af9-b1db2551f98c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg"
Jul 10 21:21:50.743069 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.743047    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tc6m7" event={"ID":"4059fb8a-cf89-4590-93c4-4d817e332b86","Type":"ContainerStarted","Data":"c05c89035045d8a85328e843221d33fb1e23b14482b31b58d90eeb4066423ffe"}
Jul 10 21:21:50.746194 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.746170    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3fa67b9f-8584-4a47-8af9-b1db2551f98c-signing-key\") pod \"service-ca-79f68b9f4f-9ktrg\" (UID: \"3fa67b9f-8584-4a47-8af9-b1db2551f98c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg"
Jul 10 21:21:50.746315 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.746264    2575 generic.go:356] "Generic (PLEG): container finished" podID="50c2c491-0a3d-46df-8992-e3360667a5a3" containerID="9470e3d39f0b60e301d4390e242d5c2639b1b14d44eb32d27fec2f59b16e8f0b" exitCode=0
Jul 10 21:21:50.746371 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.746335    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvw4p" event={"ID":"50c2c491-0a3d-46df-8992-e3360667a5a3","Type":"ContainerDied","Data":"9470e3d39f0b60e301d4390e242d5c2639b1b14d44eb32d27fec2f59b16e8f0b"}
Jul 10 21:21:50.751603 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.751578    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj485\" (UniqueName: \"kubernetes.io/projected/3fa67b9f-8584-4a47-8af9-b1db2551f98c-kube-api-access-sj485\") pod \"service-ca-79f68b9f4f-9ktrg\" (UID: \"3fa67b9f-8584-4a47-8af9-b1db2551f98c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg"
Jul 10 21:21:50.840237 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.840211    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg"
Jul 10 21:21:50.943785 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.943754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.943785 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.943790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:50.944039 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.943825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:50.944039 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.943855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:50.944039 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.943920    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 21:21:50.944039 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.943940    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 21:21:50.944039 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.943946    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 21:21:50.944039 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.943963    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 21:21:50.944039 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.943978    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548b95f5c9-vlqqd: secret "image-registry-tls" not found
Jul 10 21:21:50.944039 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.943999    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls podName:e84fed44-e9d5-4f3e-bc43-d1df60683820 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:51.943982946 +0000 UTC m=+37.577228188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls") pod "dns-default-44hf6" (UID: "e84fed44-e9d5-4f3e-bc43-d1df60683820") : secret "dns-default-metrics-tls" not found
Jul 10 21:21:50.944039 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.944014    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls podName:83b4c122-9bc3-4ff3-860b-4e94b8dda99a nodeName:}" failed. No retries permitted until 2026-07-10 21:21:51.944007808 +0000 UTC m=+37.577253039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k6wlt" (UID: "83b4c122-9bc3-4ff3-860b-4e94b8dda99a") : secret "insights-runtime-extractor-tls" not found
Jul 10 21:21:50.944039 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.944027    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm podName:83b4c122-9bc3-4ff3-860b-4e94b8dda99a nodeName:}" failed. No retries permitted until 2026-07-10 21:21:51.944021471 +0000 UTC m=+37.577266702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k6wlt" (UID: "83b4c122-9bc3-4ff3-860b-4e94b8dda99a") : configmap "kube-rbac-proxy" not found
Jul 10 21:21:50.944039 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:50.944048    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls podName:6b262f9e-6d68-4a6f-8d00-7259b67b14b4 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:51.944031761 +0000 UTC m=+37.577276996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls") pod "image-registry-548b95f5c9-vlqqd" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4") : secret "image-registry-tls" not found
Jul 10 21:21:50.971947 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:50.971910    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-9ktrg"]
Jul 10 21:21:50.975758 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:21:50.975722    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa67b9f_8584_4a47_8af9_b1db2551f98c.slice/crio-443f47a7cbdabd5e8ceb39521d93f2d06e830797c7fabcce62cb0a27845c93c1 WatchSource:0}: Error finding container 443f47a7cbdabd5e8ceb39521d93f2d06e830797c7fabcce62cb0a27845c93c1: Status 404 returned error can't find the container with id 443f47a7cbdabd5e8ceb39521d93f2d06e830797c7fabcce62cb0a27845c93c1
Jul 10 21:21:51.462261 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:51.462079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:51.743104 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:51.743024    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vsh7h_92b95e58-9d5d-4939-bb6e-c6b0c246546f/dns-node-resolver/0.log"
Jul 10 21:21:51.751260 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:51.751227    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg" event={"ID":"3fa67b9f-8584-4a47-8af9-b1db2551f98c","Type":"ContainerStarted","Data":"443f47a7cbdabd5e8ceb39521d93f2d06e830797c7fabcce62cb0a27845c93c1"}
Jul 10 21:21:51.755374 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:51.754980    2575 generic.go:356] "Generic (PLEG): container finished" podID="50c2c491-0a3d-46df-8992-e3360667a5a3" containerID="802248b25e47b252296840fc89d669637e459e18449466f12eaf7d65a3508083" exitCode=0
Jul 10 21:21:51.755374 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:51.755028    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvw4p" event={"ID":"50c2c491-0a3d-46df-8992-e3360667a5a3","Type":"ContainerDied","Data":"802248b25e47b252296840fc89d669637e459e18449466f12eaf7d65a3508083"}
Jul 10 21:21:51.954539 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:51.954494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:51.954770 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:51.954594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:51.954770 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:51.954624    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:51.954770 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:51.954631    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 21:21:51.954770 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:51.954676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:51.954770 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:51.954697    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm podName:83b4c122-9bc3-4ff3-860b-4e94b8dda99a nodeName:}" failed. No retries permitted until 2026-07-10 21:21:53.954677653 +0000 UTC m=+39.587922905 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k6wlt" (UID: "83b4c122-9bc3-4ff3-860b-4e94b8dda99a") : configmap "kube-rbac-proxy" not found
Jul 10 21:21:51.954770 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:51.954763    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 21:21:51.954770 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:51.954774    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548b95f5c9-vlqqd: secret "image-registry-tls" not found
Jul 10 21:21:51.955070 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:51.954776    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 21:21:51.955070 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:51.954812    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls podName:6b262f9e-6d68-4a6f-8d00-7259b67b14b4 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:53.954798611 +0000 UTC m=+39.588043845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls") pod "image-registry-548b95f5c9-vlqqd" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4") : secret "image-registry-tls" not found
Jul 10 21:21:51.955070 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:51.954844    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls podName:83b4c122-9bc3-4ff3-860b-4e94b8dda99a nodeName:}" failed. No retries permitted until 2026-07-10 21:21:53.954826218 +0000 UTC m=+39.588071450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k6wlt" (UID: "83b4c122-9bc3-4ff3-860b-4e94b8dda99a") : secret "insights-runtime-extractor-tls" not found
Jul 10 21:21:51.955070 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:51.954872    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 21:21:51.955070 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:51.954899    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls podName:e84fed44-e9d5-4f3e-bc43-d1df60683820 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:53.954890252 +0000 UTC m=+39.588135490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls") pod "dns-default-44hf6" (UID: "e84fed44-e9d5-4f3e-bc43-d1df60683820") : secret "dns-default-metrics-tls" not found
Jul 10 21:21:52.344933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:52.344900    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4xzxz_7d58d1e4-af64-4f0c-972e-a2e02bc12421/node-ca/0.log"
Jul 10 21:21:52.762394 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:52.762295    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvw4p" event={"ID":"50c2c491-0a3d-46df-8992-e3360667a5a3","Type":"ContainerStarted","Data":"1da84b9fcce52d6b3759b1b78384d9eae202e90e8743e1f40509a5f33f425082"}
Jul 10 21:21:52.789938 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:52.789888    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xvw4p" podStartSLOduration=7.733331917 podStartE2EDuration="36.7898692s" totalImagesPullingTime="29.056537283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:52.788424211 +0000 UTC m=+38.421669466" watchObservedRunningTime="2026-07-10 21:21:52.7898692 +0000 UTC m=+38.423114453"
Jul 10 21:21:53.972569 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:53.972531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:53.972569 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:53.972575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:53.973152 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:53.972672    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 21:21:53.973152 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:53.972708    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:53.973152 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:53.972728    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls podName:e84fed44-e9d5-4f3e-bc43-d1df60683820 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:57.972710799 +0000 UTC m=+43.605956031 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls") pod "dns-default-44hf6" (UID: "e84fed44-e9d5-4f3e-bc43-d1df60683820") : secret "dns-default-metrics-tls" not found
Jul 10 21:21:53.973152 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:53.972673    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 21:21:53.973152 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:53.972782    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 21:21:53.973152 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:53.972796    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548b95f5c9-vlqqd: secret "image-registry-tls" not found
Jul 10 21:21:53.973152 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:53.972812    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls podName:83b4c122-9bc3-4ff3-860b-4e94b8dda99a nodeName:}" failed. No retries permitted until 2026-07-10 21:21:57.972778043 +0000 UTC m=+43.606023274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k6wlt" (UID: "83b4c122-9bc3-4ff3-860b-4e94b8dda99a") : secret "insights-runtime-extractor-tls" not found
Jul 10 21:21:53.973152 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:53.972826    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 21:21:53.973152 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:53.972840    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls podName:6b262f9e-6d68-4a6f-8d00-7259b67b14b4 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:57.9728307 +0000 UTC m=+43.606075932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls") pod "image-registry-548b95f5c9-vlqqd" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4") : secret "image-registry-tls" not found
Jul 10 21:21:53.973152 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:53.972781    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:53.973152 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:53.972862    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm podName:83b4c122-9bc3-4ff3-860b-4e94b8dda99a nodeName:}" failed. No retries permitted until 2026-07-10 21:21:57.972852083 +0000 UTC m=+43.606097317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k6wlt" (UID: "83b4c122-9bc3-4ff3-860b-4e94b8dda99a") : configmap "kube-rbac-proxy" not found
Jul 10 21:21:54.152492 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:54.152462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:54.604763 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:54.604728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:54.769187 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:54.769150    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tc6m7" event={"ID":"4059fb8a-cf89-4590-93c4-4d817e332b86","Type":"ContainerStarted","Data":"ed419183402933a2fd72641e820064886b7a1bed352351631d80d9cd53b55153"}
Jul 10 21:21:54.770772 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:54.770743    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg" event={"ID":"3fa67b9f-8584-4a47-8af9-b1db2551f98c","Type":"ContainerStarted","Data":"b36c01749fdb960e09c6ff83e96ae26d56dfa2d96722d934c0af9d312f99b95a"}
Jul 10 21:21:54.787264 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:54.787061    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tc6m7" podStartSLOduration=1.367762781 podStartE2EDuration="4.787043829s" totalImagesPullingTime="3.419281048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:21:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:54.786716338 +0000 UTC m=+40.419961593" watchObservedRunningTime="2026-07-10 21:21:54.787043829 +0000 UTC m=+40.420289073"
Jul 10 21:21:54.805104 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:54.805048    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-9ktrg" podStartSLOduration=1.62338708 podStartE2EDuration="4.805024484s" totalImagesPullingTime="3.181637404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:21:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:54.803961614 +0000 UTC m=+40.437206868" watchObservedRunningTime="2026-07-10 21:21:54.805024484 +0000 UTC m=+40.438269740"
Jul 10 21:21:55.597948 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:55.597904    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:55.732645 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:55.732586    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:55.832612 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:55.832576    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:55.948671 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:55.948559    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:56.054371 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:56.054332    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:56.502250 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:56.502196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:57.073157 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:57.073111    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:57.138827 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:57.138792    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:57.293226 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:57.293182    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:57.692858 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:57.692799    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:57.794331 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:57.794297    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:57.894097 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:57.894062    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:57.993761 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:57.993676    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:58.008458 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:58.008429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:58.008612 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:58.008462    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:21:58.008612 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:58.008499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:21:58.008612 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:58.008542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:58.008612 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:58.008606    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 21:21:58.008797 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:58.008655    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 21:21:58.008797 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:58.008668    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 21:21:58.008797 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:58.008682    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls podName:e84fed44-e9d5-4f3e-bc43-d1df60683820 nodeName:}" failed. No retries permitted until 2026-07-10 21:22:06.008659095 +0000 UTC m=+51.641904331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls") pod "dns-default-44hf6" (UID: "e84fed44-e9d5-4f3e-bc43-d1df60683820") : secret "dns-default-metrics-tls" not found
Jul 10 21:21:58.008797 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:58.008683    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548b95f5c9-vlqqd: secret "image-registry-tls" not found
Jul 10 21:21:58.008797 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:58.008715    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls podName:83b4c122-9bc3-4ff3-860b-4e94b8dda99a nodeName:}" failed. No retries permitted until 2026-07-10 21:22:06.008697353 +0000 UTC m=+51.641942588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k6wlt" (UID: "83b4c122-9bc3-4ff3-860b-4e94b8dda99a") : secret "insights-runtime-extractor-tls" not found
Jul 10 21:21:58.008797 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:21:58.008734    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls podName:6b262f9e-6d68-4a6f-8d00-7259b67b14b4 nodeName:}" failed. No retries permitted until 2026-07-10 21:22:06.008724822 +0000 UTC m=+51.641970056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls") pod "image-registry-548b95f5c9-vlqqd" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4") : secret "image-registry-tls" not found
Jul 10 21:21:58.009067 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:58.009049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:21:58.094004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:58.093975    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:58.317026 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:58.316941    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:58.419159 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:58.419126    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:59.219244 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:59.219212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:59.319028 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:59.318995    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:59.419830 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:59.419796    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:59.703538 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:59.703505    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:59.897075 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:59.897028    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:21:59.998228 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:21:59.998145    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:00.101793 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:00.101762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:00.492370 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:00.492326    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:01.298579 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:01.298544    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:01.488386 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:01.488354    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:01.799021 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:01.798989    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:01.900111 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:01.900082    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:02.091258 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:02.091227    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:02.496445 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:02.496364    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:02.887883 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:02.887849    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:03.197955 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:03.197873    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:03.490039 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:03.489958    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:03.891350 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:03.891319    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:04.097282 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:04.097213    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:04.702043 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:04.702004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:04.904869 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:04.904834    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:05.488736 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:05.488704    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:05.907645 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:05.907612    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:06.074189 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.074147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:22:06.074189 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.074184    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:22:06.074418 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.074219    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:22:06.077721 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.077690    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83b4c122-9bc3-4ff3-860b-4e94b8dda99a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6wlt\" (UID: \"83b4c122-9bc3-4ff3-860b-4e94b8dda99a\") " pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:22:06.077858 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.077700    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e84fed44-e9d5-4f3e-bc43-d1df60683820-metrics-tls\") pod \"dns-default-44hf6\" (UID: \"e84fed44-e9d5-4f3e-bc43-d1df60683820\") " pod="openshift-dns/dns-default-44hf6"
Jul 10 21:22:06.077858 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.077749    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls\") pod \"image-registry-548b95f5c9-vlqqd\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") " pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:22:06.095725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.095676    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:06.108704 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.108681    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:22:06.120823 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.120798    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-44hf6"
Jul 10 21:22:06.150341 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.150309    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k6wlt"
Jul 10 21:22:06.276633 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.276602    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-548b95f5c9-vlqqd"]
Jul 10 21:22:06.286891 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:22:06.286862    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b262f9e_6d68_4a6f_8d00_7259b67b14b4.slice/crio-42bf7d84114a370f84105fa7667cd6f4715a7d7c0743e5626472dd0d9f3a36ac WatchSource:0}: Error finding container 42bf7d84114a370f84105fa7667cd6f4715a7d7c0743e5626472dd0d9f3a36ac: Status 404 returned error can't find the container with id 42bf7d84114a370f84105fa7667cd6f4715a7d7c0743e5626472dd0d9f3a36ac
Jul 10 21:22:06.296289 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.296182    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:06.296911 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.296889    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-44hf6"]
Jul 10 21:22:06.299585 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:22:06.299560    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode84fed44_e9d5_4f3e_bc43_d1df60683820.slice/crio-eb409b29a46fa9569c66572549790a3877204d1fb8076c3054505198bcf8064d WatchSource:0}: Error finding container eb409b29a46fa9569c66572549790a3877204d1fb8076c3054505198bcf8064d: Status 404 returned error can't find the container with id eb409b29a46fa9569c66572549790a3877204d1fb8076c3054505198bcf8064d
Jul 10 21:22:06.319156 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.319128    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k6wlt"]
Jul 10 21:22:06.321994 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:22:06.321970    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b4c122_9bc3_4ff3_860b_4e94b8dda99a.slice/crio-e1f0926504aac2b56f206e24ee0da6448d378457ccc0ad82b2a68181221e755f WatchSource:0}: Error finding container e1f0926504aac2b56f206e24ee0da6448d378457ccc0ad82b2a68181221e755f: Status 404 returned error can't find the container with id e1f0926504aac2b56f206e24ee0da6448d378457ccc0ad82b2a68181221e755f
Jul 10 21:22:06.802111 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.802071    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-44hf6" event={"ID":"e84fed44-e9d5-4f3e-bc43-d1df60683820","Type":"ContainerStarted","Data":"eb409b29a46fa9569c66572549790a3877204d1fb8076c3054505198bcf8064d"}
Jul 10 21:22:06.803400 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.803372    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k6wlt" event={"ID":"83b4c122-9bc3-4ff3-860b-4e94b8dda99a","Type":"ContainerStarted","Data":"e1f0926504aac2b56f206e24ee0da6448d378457ccc0ad82b2a68181221e755f"}
Jul 10 21:22:06.804730 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.804709    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd" event={"ID":"6b262f9e-6d68-4a6f-8d00-7259b67b14b4","Type":"ContainerStarted","Data":"9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f"}
Jul 10 21:22:06.804825 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.804742    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd" event={"ID":"6b262f9e-6d68-4a6f-8d00-7259b67b14b4","Type":"ContainerStarted","Data":"42bf7d84114a370f84105fa7667cd6f4715a7d7c0743e5626472dd0d9f3a36ac"}
Jul 10 21:22:06.828310 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:06.828237    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd" podStartSLOduration=56.828219123 podStartE2EDuration="56.828219123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:21:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:06.826617558 +0000 UTC m=+52.459862815" watchObservedRunningTime="2026-07-10 21:22:06.828219123 +0000 UTC m=+52.461464355"
Jul 10 21:22:07.807834 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:07.807795    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:22:11.820938 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:11.820903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-44hf6" event={"ID":"e84fed44-e9d5-4f3e-bc43-d1df60683820","Type":"ContainerStarted","Data":"de824f4c2ba0058633a103b0cc22c52bcbf00cb997879d09fc6cd8a9cc9208f3"}
Jul 10 21:22:11.821450 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:11.820969    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-44hf6"
Jul 10 21:22:11.821450 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:11.820991    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-44hf6" event={"ID":"e84fed44-e9d5-4f3e-bc43-d1df60683820","Type":"ContainerStarted","Data":"04da14bc1676875e9861a45fa16c65ba8ee56b4b0b065501b23e91aecb019def"}
Jul 10 21:22:11.822727 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:11.822703    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k6wlt" event={"ID":"83b4c122-9bc3-4ff3-860b-4e94b8dda99a","Type":"ContainerStarted","Data":"527e110bbb306320ffc0d18d7c8b52b4e916387e3235c301705927a73a2ff4ac"}
Jul 10 21:22:11.822817 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:11.822751    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k6wlt" event={"ID":"83b4c122-9bc3-4ff3-860b-4e94b8dda99a","Type":"ContainerStarted","Data":"5094b2379fb5ce93f144fc4fac4574707765c53125a8cc5bc22c3394bcef39c2"}
Jul 10 21:22:11.840496 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:11.840390    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-44hf6" podStartSLOduration=17.270835526 podStartE2EDuration="21.840373963s" totalImagesPullingTime="4.569538437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:21:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:11.839747961 +0000 UTC m=+57.472993214" watchObservedRunningTime="2026-07-10 21:22:11.840373963 +0000 UTC m=+57.473619219"
Jul 10 21:22:12.571291 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.571240    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"]
Jul 10 21:22:12.573572 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.573549    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx"]
Jul 10 21:22:12.573715 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.573699    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.575395 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.575373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx"
Jul 10 21:22:12.578482 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.578452    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 10 21:22:12.578812 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.578793    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 10 21:22:12.578918 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.578835    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 10 21:22:12.578918 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.578858    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 10 21:22:12.579214 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.579197    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 10 21:22:12.579381 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.579197    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 10 21:22:12.579789 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.579772    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 10 21:22:12.580240 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.580221    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 10 21:22:12.582077 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.582060    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-79d69\""
Jul 10 21:22:12.595013 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.594943    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"]
Jul 10 21:22:12.595936 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.595913    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx"]
Jul 10 21:22:12.612582 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.612557    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-548b95f5c9-vlqqd"]
Jul 10 21:22:12.631097 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.631064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e2bacdec-1ec6-4651-9761-008c53026f3a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.631267 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.631125    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1bccad01-9144-4d82-a999-99fe7c5ba45e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx\" (UID: \"1bccad01-9144-4d82-a999-99fe7c5ba45e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx"
Jul 10 21:22:12.631267 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.631207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r889l\" (UniqueName: \"kubernetes.io/projected/e2bacdec-1ec6-4651-9761-008c53026f3a-kube-api-access-r889l\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.631388 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.631304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2bacdec-1ec6-4651-9761-008c53026f3a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.631388 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.631346    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgct9\" (UniqueName: \"kubernetes.io/projected/1bccad01-9144-4d82-a999-99fe7c5ba45e-kube-api-access-cgct9\") pod \"managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx\" (UID: \"1bccad01-9144-4d82-a999-99fe7c5ba45e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx"
Jul 10 21:22:12.631388 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.631369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2bacdec-1ec6-4651-9761-008c53026f3a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.631521 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.631425    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e2bacdec-1ec6-4651-9761-008c53026f3a-ca\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.631521 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.631457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e2bacdec-1ec6-4651-9761-008c53026f3a-hub\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.732558 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.732517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r889l\" (UniqueName: \"kubernetes.io/projected/e2bacdec-1ec6-4651-9761-008c53026f3a-kube-api-access-r889l\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.732741 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.732660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2bacdec-1ec6-4651-9761-008c53026f3a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.732741 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.732706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgct9\" (UniqueName: \"kubernetes.io/projected/1bccad01-9144-4d82-a999-99fe7c5ba45e-kube-api-access-cgct9\") pod \"managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx\" (UID: \"1bccad01-9144-4d82-a999-99fe7c5ba45e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx"
Jul 10 21:22:12.732741 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.732733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2bacdec-1ec6-4651-9761-008c53026f3a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.732900 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.732763    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e2bacdec-1ec6-4651-9761-008c53026f3a-ca\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.732900 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.732788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e2bacdec-1ec6-4651-9761-008c53026f3a-hub\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.733015 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.732987    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e2bacdec-1ec6-4651-9761-008c53026f3a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.733074 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.733054    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1bccad01-9144-4d82-a999-99fe7c5ba45e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx\" (UID: \"1bccad01-9144-4d82-a999-99fe7c5ba45e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx"
Jul 10 21:22:12.733734 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.733671    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2bacdec-1ec6-4651-9761-008c53026f3a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.735787 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.735766    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e2bacdec-1ec6-4651-9761-008c53026f3a-hub\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.735901 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.735846    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2bacdec-1ec6-4651-9761-008c53026f3a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.736088 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.736031    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1bccad01-9144-4d82-a999-99fe7c5ba45e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx\" (UID: \"1bccad01-9144-4d82-a999-99fe7c5ba45e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx"
Jul 10 21:22:12.736300 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.736260    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e2bacdec-1ec6-4651-9761-008c53026f3a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.736300 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.736292    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e2bacdec-1ec6-4651-9761-008c53026f3a-ca\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.768866 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.768833    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgct9\" (UniqueName: \"kubernetes.io/projected/1bccad01-9144-4d82-a999-99fe7c5ba45e-kube-api-access-cgct9\") pod \"managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx\" (UID: \"1bccad01-9144-4d82-a999-99fe7c5ba45e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx"
Jul 10 21:22:12.770953 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.770921    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:12.776759 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.776735    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r889l\" (UniqueName: \"kubernetes.io/projected/e2bacdec-1ec6-4651-9761-008c53026f3a-kube-api-access-r889l\") pod \"cluster-proxy-proxy-agent-d7b9f8855-g786p\" (UID: \"e2bacdec-1ec6-4651-9761-008c53026f3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.903236 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.903198    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"
Jul 10 21:22:12.904391 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.904358    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:12.909419 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:12.909392    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx"
Jul 10 21:22:13.013608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:13.013578    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:13.069786 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:13.069745    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p"]
Jul 10 21:22:13.073299 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:22:13.073255    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2bacdec_1ec6_4651_9761_008c53026f3a.slice/crio-a49824d89423685dbfb4cc06a1be0daed83243a74ba8dbf6bcf1cf02e15814d1 WatchSource:0}: Error finding container a49824d89423685dbfb4cc06a1be0daed83243a74ba8dbf6bcf1cf02e15814d1: Status 404 returned error can't find the container with id a49824d89423685dbfb4cc06a1be0daed83243a74ba8dbf6bcf1cf02e15814d1
Jul 10 21:22:13.081406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:13.081376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx"]
Jul 10 21:22:13.084997 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:22:13.084973    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bccad01_9144_4d82_a999_99fe7c5ba45e.slice/crio-16c06b2fbcefccd1584d816791485c99e1d34c814bd4f7ce40f3981ec80d03d1 WatchSource:0}: Error finding container 16c06b2fbcefccd1584d816791485c99e1d34c814bd4f7ce40f3981ec80d03d1: Status 404 returned error can't find the container with id 16c06b2fbcefccd1584d816791485c99e1d34c814bd4f7ce40f3981ec80d03d1
Jul 10 21:22:13.106254 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:13.106217    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:13.206375 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:13.206286    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:13.832205 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:13.832170    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx" event={"ID":"1bccad01-9144-4d82-a999-99fe7c5ba45e","Type":"ContainerStarted","Data":"16c06b2fbcefccd1584d816791485c99e1d34c814bd4f7ce40f3981ec80d03d1"}
Jul 10 21:22:13.833526 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:13.833498    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p" event={"ID":"e2bacdec-1ec6-4651-9761-008c53026f3a","Type":"ContainerStarted","Data":"a49824d89423685dbfb4cc06a1be0daed83243a74ba8dbf6bcf1cf02e15814d1"}
Jul 10 21:22:14.841314 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:14.841001    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k6wlt" event={"ID":"83b4c122-9bc3-4ff3-860b-4e94b8dda99a","Type":"ContainerStarted","Data":"7a120cbbf0a2abc3794c398f175e638cfee114c1fffc7c978c18e70ff71107a1"}
Jul 10 21:22:14.864295 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:14.863955    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k6wlt" podStartSLOduration=17.129700392 podStartE2EDuration="24.863931506s" totalImagesPullingTime="7.734231114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:14.86183804 +0000 UTC m=+60.495083295" watchObservedRunningTime="2026-07-10 21:22:14.863931506 +0000 UTC m=+60.497176760"
Jul 10 21:22:16.743989 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:16.743955    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9lqx"
Jul 10 21:22:16.906869 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:16.906821    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:17.005186 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.005097    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:17.103125 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.103087    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:17.179780 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.179748    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:17.254547 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.254505    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:17.435378 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.435345    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:17.533378 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.533344    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:17.634467 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.634413    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:17.752506 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.752461    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:17.853300 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.853241    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx" event={"ID":"1bccad01-9144-4d82-a999-99fe7c5ba45e","Type":"ContainerStarted","Data":"327b4bbd88ac336bc5ce7cfb62052b8f8c95c79ec6b01a133748689907ebba5d"}
Jul 10 21:22:17.855182 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.855157    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p" event={"ID":"e2bacdec-1ec6-4651-9761-008c53026f3a","Type":"ContainerStarted","Data":"e408d155e0455053436e41655340c6469eb902580e594a8e8048046feed83d59"}
Jul 10 21:22:17.855317 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.855188    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p" event={"ID":"e2bacdec-1ec6-4651-9761-008c53026f3a","Type":"ContainerStarted","Data":"55eb62e2e09e6dcbfcb63005894771fa57c38e34aec7359490eadc781bcb0c27"}
Jul 10 21:22:17.855317 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.855200    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p" event={"ID":"e2bacdec-1ec6-4651-9761-008c53026f3a","Type":"ContainerStarted","Data":"821d6fc329d6f2dfe6ffa8779355dbdda9325a47bf51e886790b5ce1a6a90038"}
Jul 10 21:22:17.870742 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.870690    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c5f8d7bfb-fs7wx" podStartSLOduration=1.433508082 podStartE2EDuration="5.870674197s" totalImagesPullingTime="4.437166115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:17.869747602 +0000 UTC m=+63.502992856" watchObservedRunningTime="2026-07-10 21:22:17.870674197 +0000 UTC m=+63.503919450"
Jul 10 21:22:17.889044 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.888994    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7b9f8855-g786p" podStartSLOduration=1.428120659 podStartE2EDuration="5.888961876s" totalImagesPullingTime="4.460841217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:17.887691107 +0000 UTC m=+63.520936361" watchObservedRunningTime="2026-07-10 21:22:17.888961876 +0000 UTC m=+63.522207168"
Jul 10 21:22:17.965997 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:17.965924    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:18.162593 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:18.162557    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:18.253768 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:18.253680    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:18.367298 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:18.367239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:18.466969 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:18.466941    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:19.168069 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:19.168034    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:19.264494 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:19.264462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:19.364074 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:19.364040    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:19.547947 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:19.547845    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:19.648354 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:19.648323    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:19.749000 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:19.748969    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:20.564042 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:20.564008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:20.668153 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:20.668123    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:21.307358 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.307318    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:22:21.307358 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.307359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:22:21.309885 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.309863    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 21:22:21.310552 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.310536    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 21:22:21.320709 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.320674    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69a397c0-e18d-435c-b66e-3557a9bb5851-metrics-certs\") pod \"network-metrics-daemon-l8sdv\" (UID: \"69a397c0-e18d-435c-b66e-3557a9bb5851\") " pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:22:21.320817 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.320674    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adb715a1-fa72-4b85-b1b1-1a2ddfebac5d-original-pull-secret\") pod \"global-pull-secret-syncer-279g5\" (UID: \"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d\") " pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:22:21.407918 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.407881    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhbg\" (UniqueName: \"kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg\") pod \"network-check-target-4g72n\" (UID: \"ab9864ff-802f-4b23-baf5-e15e761ff147\") " pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:22:21.410782 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.410760    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 21:22:21.421444 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.421409    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 21:22:21.432244 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.432206    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzhbg\" (UniqueName: \"kubernetes.io/projected/ab9864ff-802f-4b23-baf5-e15e761ff147-kube-api-access-lzhbg\") pod \"network-check-target-4g72n\" (UID: \"ab9864ff-802f-4b23-baf5-e15e761ff147\") " pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:22:21.452461 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.452431    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nklrg\""
Jul 10 21:22:21.459574 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.459548    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j44v2\""
Jul 10 21:22:21.460576 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.460557    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:22:21.463929 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.463908    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-279g5"
Jul 10 21:22:21.466995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.466974    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8sdv"
Jul 10 21:22:21.647021 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.646879    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4g72n"]
Jul 10 21:22:21.650249 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:22:21.650219    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9864ff_802f_4b23_baf5_e15e761ff147.slice/crio-f5854b569bf270e99d7c8131b1d5e3c6e379bba36a731190cbade32043783db0 WatchSource:0}: Error finding container f5854b569bf270e99d7c8131b1d5e3c6e379bba36a731190cbade32043783db0: Status 404 returned error can't find the container with id f5854b569bf270e99d7c8131b1d5e3c6e379bba36a731190cbade32043783db0
Jul 10 21:22:21.676333 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.674423    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-279g5"]
Jul 10 21:22:21.679898 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:22:21.679871    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb715a1_fa72_4b85_b1b1_1a2ddfebac5d.slice/crio-67ba336346fa2389377bb91f329a55852fc7390be78a7f49b5ae3a51e0a03ee4 WatchSource:0}: Error finding container 67ba336346fa2389377bb91f329a55852fc7390be78a7f49b5ae3a51e0a03ee4: Status 404 returned error can't find the container with id 67ba336346fa2389377bb91f329a55852fc7390be78a7f49b5ae3a51e0a03ee4
Jul 10 21:22:21.693003 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.692971    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l8sdv"]
Jul 10 21:22:21.696177 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:22:21.696150    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a397c0_e18d_435c_b66e_3557a9bb5851.slice/crio-61e21f1fd745e84ad4b8d93d243dd81b14670046b9a05d043d90c1edc97f360c WatchSource:0}: Error finding container 61e21f1fd745e84ad4b8d93d243dd81b14670046b9a05d043d90c1edc97f360c: Status 404 returned error can't find the container with id 61e21f1fd745e84ad4b8d93d243dd81b14670046b9a05d043d90c1edc97f360c
Jul 10 21:22:21.829582 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.829549    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-44hf6"
Jul 10 21:22:21.884098 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.884059    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-279g5" event={"ID":"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d","Type":"ContainerStarted","Data":"67ba336346fa2389377bb91f329a55852fc7390be78a7f49b5ae3a51e0a03ee4"}
Jul 10 21:22:21.885257 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.885219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l8sdv" event={"ID":"69a397c0-e18d-435c-b66e-3557a9bb5851","Type":"ContainerStarted","Data":"61e21f1fd745e84ad4b8d93d243dd81b14670046b9a05d043d90c1edc97f360c"}
Jul 10 21:22:21.886580 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:21.886554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4g72n" event={"ID":"ab9864ff-802f-4b23-baf5-e15e761ff147","Type":"ContainerStarted","Data":"f5854b569bf270e99d7c8131b1d5e3c6e379bba36a731190cbade32043783db0"}
Jul 10 21:22:22.620451 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:22.620362    2575 patch_prober.go:28] interesting pod/image-registry-548b95f5c9-vlqqd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 10 21:22:22.620451 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:22.620430    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd" podUID="6b262f9e-6d68-4a6f-8d00-7259b67b14b4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 21:22:23.161378 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:23.161262    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:23.242916 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:23.242793    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:23.390766 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:23.390720    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:23.505336 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:23.505230    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:23.602415 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:23.602349    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:23.667952 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:23.667891    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:23.898756 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:23.898384    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l8sdv" event={"ID":"69a397c0-e18d-435c-b66e-3557a9bb5851","Type":"ContainerStarted","Data":"faa6e9a3dadb6a0d05f67594d4a48ce968d8ed75724b36405b9f31fc739bc605"}
Jul 10 21:22:23.898756 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:23.898451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l8sdv" event={"ID":"69a397c0-e18d-435c-b66e-3557a9bb5851","Type":"ContainerStarted","Data":"f85ebccfeae499cc5842ebba73ffd061208d894a0da35d3e02b6e8473855309f"}
Jul 10 21:22:23.916413 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:23.915980    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l8sdv" podStartSLOduration=66.791711091 podStartE2EDuration="1m7.91595725s" totalImagesPullingTime="1.124246159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:23.915483204 +0000 UTC m=+69.548728474" watchObservedRunningTime="2026-07-10 21:22:23.91595725 +0000 UTC m=+69.549202506"
Jul 10 21:22:24.017691 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:24.017654    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:24.083503 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:24.083467    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:25.279693 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:25.279654    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:25.352666 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:25.352625    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:25.867736 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:25.867698    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:26.910008 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:26.909967    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4g72n" event={"ID":"ab9864ff-802f-4b23-baf5-e15e761ff147","Type":"ContainerStarted","Data":"a156679664c19b9d3f9286b12df0b75b41a7881c070fe00787645e37b12bfcc9"}
Jul 10 21:22:26.910469 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:26.910063    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:22:26.911316 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:26.911267    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-279g5" event={"ID":"adb715a1-fa72-4b85-b1b1-1a2ddfebac5d","Type":"ContainerStarted","Data":"0c2d621350542d0a4a15a5d765e5f961ce8ba49f2b89650406e79f1827318ac9"}
Jul 10 21:22:26.942692 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:26.942625    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4g72n" podStartSLOduration=66.367450263 podStartE2EDuration="1m10.942604372s" totalImagesPullingTime="4.575154109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:26.941319812 +0000 UTC m=+72.574565067" watchObservedRunningTime="2026-07-10 21:22:26.942604372 +0000 UTC m=+72.575849627"
Jul 10 21:22:26.967898 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:26.967842    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-279g5" podStartSLOduration=66.417859748 podStartE2EDuration="1m10.967824198s" totalImagesPullingTime="4.54996445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:26.967730356 +0000 UTC m=+72.600975611" watchObservedRunningTime="2026-07-10 21:22:26.967824198 +0000 UTC m=+72.601069452"
Jul 10 21:22:27.788814 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:27.788780    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:27.890610 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:27.890568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:28.315691 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.315657    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:28.526730 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.526694    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:28.691058 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.691020    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9qksg"]
Jul 10 21:22:28.705929 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.705891    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:28.715993 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.715957    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.720034 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.719996    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 21:22:28.720193 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.720066    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 21:22:28.720193 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.720098    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 21:22:28.720453 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.720436    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 21:22:28.721143 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.721115    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 21:22:28.721200 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.721152    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 21:22:28.721401 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.721389    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5pwrj\""
Jul 10 21:22:28.831996 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.831966    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:28.865102 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.865062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-tls\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.865102 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.865099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53f035c5-d92a-479f-810a-bd34f4ad2adc-sys\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.865375 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.865117    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53f035c5-d92a-479f-810a-bd34f4ad2adc-metrics-client-ca\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.865375 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.865145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.865375 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.865175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsphm\" (UniqueName: \"kubernetes.io/projected/53f035c5-d92a-479f-810a-bd34f4ad2adc-kube-api-access-xsphm\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.865375 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.865247    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-wtmp\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.865375 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.865337    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-textfile\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.865625 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.865394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.865625 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.865426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53f035c5-d92a-479f-810a-bd34f4ad2adc-root\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.929486 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.929449    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:28.966665 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.966579    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.966665 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.966631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53f035c5-d92a-479f-810a-bd34f4ad2adc-root\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.966665 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.966658    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-tls\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.966665 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.966675    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53f035c5-d92a-479f-810a-bd34f4ad2adc-sys\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.966939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.966689    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53f035c5-d92a-479f-810a-bd34f4ad2adc-metrics-client-ca\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.966939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.966706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.966939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.966722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsphm\" (UniqueName: \"kubernetes.io/projected/53f035c5-d92a-479f-810a-bd34f4ad2adc-kube-api-access-xsphm\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.966939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.966740    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-wtmp\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.966939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.966771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-textfile\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.966939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.966789    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53f035c5-d92a-479f-810a-bd34f4ad2adc-sys\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.966939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.966797    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53f035c5-d92a-479f-810a-bd34f4ad2adc-root\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.966939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.966911    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-wtmp\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.967336 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.967163    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-textfile\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.967336 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.967232    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.967442 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.967426    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53f035c5-d92a-479f-810a-bd34f4ad2adc-metrics-client-ca\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.969092 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.969069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.969237 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.969221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53f035c5-d92a-479f-810a-bd34f4ad2adc-node-exporter-tls\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:28.976431 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:28.976408    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsphm\" (UniqueName: \"kubernetes.io/projected/53f035c5-d92a-479f-810a-bd34f4ad2adc-kube-api-access-xsphm\") pod \"node-exporter-9qksg\" (UID: \"53f035c5-d92a-479f-810a-bd34f4ad2adc\") " pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:29.027265 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:29.027234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9qksg"
Jul 10 21:22:29.028708 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:29.028670    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:29.037012 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:22:29.036984    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f035c5_d92a_479f_810a_bd34f4ad2adc.slice/crio-5b969936ba989a8785e13be2c643d5d7dfc430f8b92414895eee94fda5119a5b WatchSource:0}: Error finding container 5b969936ba989a8785e13be2c643d5d7dfc430f8b92414895eee94fda5119a5b: Status 404 returned error can't find the container with id 5b969936ba989a8785e13be2c643d5d7dfc430f8b92414895eee94fda5119a5b
Jul 10 21:22:29.132716 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:29.132684    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:29.284482 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:29.284401    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:29.580786 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:29.580750    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:29.673302 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:29.673227    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:29.802260 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:29.802221    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:29.922025 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:29.921948    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qksg" event={"ID":"53f035c5-d92a-479f-810a-bd34f4ad2adc","Type":"ContainerStarted","Data":"5b969936ba989a8785e13be2c643d5d7dfc430f8b92414895eee94fda5119a5b"}
Jul 10 21:22:30.127636 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:30.127606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:30.926380 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:30.926345    2575 generic.go:356] "Generic (PLEG): container finished" podID="53f035c5-d92a-479f-810a-bd34f4ad2adc" containerID="428b846f08ee804f3beac0e62386f8293bd19f0c5a94b6c312b3e15ca4fd624d" exitCode=0
Jul 10 21:22:30.926809 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:30.926399    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qksg" event={"ID":"53f035c5-d92a-479f-810a-bd34f4ad2adc","Type":"ContainerDied","Data":"428b846f08ee804f3beac0e62386f8293bd19f0c5a94b6c312b3e15ca4fd624d"}
Jul 10 21:22:30.981106 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:30.981075    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:31.051903 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:31.051862    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:31.546665 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:31.546633    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:31.634325 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:31.634247    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:31.696318 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:31.696289    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:31.829626 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:31.829554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:31.930943 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:31.930912    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:31.931910 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:31.931884    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qksg" event={"ID":"53f035c5-d92a-479f-810a-bd34f4ad2adc","Type":"ContainerStarted","Data":"8ed15f967f56084f133e87693808603b7429344b1301a1d4dc9060cc9a26660e"}
Jul 10 21:22:31.932013 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:31.931940    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qksg" event={"ID":"53f035c5-d92a-479f-810a-bd34f4ad2adc","Type":"ContainerStarted","Data":"5217f19f312cbd6368dcaa7e6edad27c1f6036b891338dadf8fcdcee6f3cfc4d"}
Jul 10 21:22:31.953575 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:31.953529    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9qksg" podStartSLOduration=2.996899428 podStartE2EDuration="3.953513307s" totalImagesPullingTime="889.933483ms" totalInitContainerRuntime="66.680396ms" isStatefulPod=true podCreationTimestamp="2026-07-10 21:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:31.952094809 +0000 UTC m=+77.585340062" watchObservedRunningTime="2026-07-10 21:22:31.953513307 +0000 UTC m=+77.586758560"
Jul 10 21:22:32.030762 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:32.030730    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:32.617172 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:32.617148    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:22:33.336346 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:33.336318    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:33.445950 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:33.445906    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:33.650358 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:33.650254    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:33.750596 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:33.750563    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:34.919901 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:34.919870    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:35.262499 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:35.262397    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:35.321933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:35.321883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:35.393796 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:35.393763    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:35.459794 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:35.459765    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:37.362319 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.362166    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b55677564-k5jms"]
Jul 10 21:22:37.365045 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.365028    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.367856 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.367821    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 21:22:37.367999 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.367916    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 21:22:37.369002 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.368978    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9dmbn\""
Jul 10 21:22:37.369002 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.368997    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 21:22:37.369180 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.369004    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 21:22:37.369180 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.369005    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 21:22:37.369180 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.369110    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 21:22:37.369180 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.369054    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 21:22:37.374407 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.374368    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 21:22:37.379212 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.379110    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b55677564-k5jms"]
Jul 10 21:22:37.528938 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.528907    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-oauth-config\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.528938 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.528941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-serving-cert\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.529133 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.528977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-trusted-ca-bundle\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.529133 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.529002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rcdc\" (UniqueName: \"kubernetes.io/projected/ec3a07fe-53c4-4e25-b4d8-102429d534d6-kube-api-access-2rcdc\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.529133 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.529070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-oauth-serving-cert\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.529133 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.529103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-config\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.529133 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.529120    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-service-ca\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.571356 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.571327    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:37.630240 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.630174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-config\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.630240 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.630204    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-service-ca\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.630432 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.630253    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-oauth-config\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.630432 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.630303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-serving-cert\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.630432 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.630349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-trusted-ca-bundle\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.630432 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.630371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rcdc\" (UniqueName: \"kubernetes.io/projected/ec3a07fe-53c4-4e25-b4d8-102429d534d6-kube-api-access-2rcdc\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.630432 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.630398    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-oauth-serving-cert\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.630982 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.630952    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-config\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.631083 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.631003    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-oauth-serving-cert\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.631125 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.631079    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-service-ca\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.631225 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.631200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-trusted-ca-bundle\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.633266 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.633246    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-serving-cert\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.633420 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.633402    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-oauth-config\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.636627 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.636599    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd" podUID="6b262f9e-6d68-4a6f-8d00-7259b67b14b4" containerName="registry" containerID="cri-o://9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f" gracePeriod=30
Jul 10 21:22:37.641038 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.641011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rcdc\" (UniqueName: \"kubernetes.io/projected/ec3a07fe-53c4-4e25-b4d8-102429d534d6-kube-api-access-2rcdc\") pod \"console-b55677564-k5jms\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") " pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.675204 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.675167    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:37.809223 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.809201    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b55677564-k5jms"]
Jul 10 21:22:37.811080 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:22:37.811047    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3a07fe_53c4_4e25_b4d8_102429d534d6.slice/crio-9fe8762b687a58f38c7eb35fba304c879ad042f39aff88a0ad308948b5155a25 WatchSource:0}: Error finding container 9fe8762b687a58f38c7eb35fba304c879ad042f39aff88a0ad308948b5155a25: Status 404 returned error can't find the container with id 9fe8762b687a58f38c7eb35fba304c879ad042f39aff88a0ad308948b5155a25
Jul 10 21:22:37.882144 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.882079    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:22:37.953105 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.953067    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b55677564-k5jms" event={"ID":"ec3a07fe-53c4-4e25-b4d8-102429d534d6","Type":"ContainerStarted","Data":"9fe8762b687a58f38c7eb35fba304c879ad042f39aff88a0ad308948b5155a25"}
Jul 10 21:22:37.954291 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.954252    2575 generic.go:356] "Generic (PLEG): container finished" podID="6b262f9e-6d68-4a6f-8d00-7259b67b14b4" containerID="9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f" exitCode=0
Jul 10 21:22:37.954375 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.954311    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd"
Jul 10 21:22:37.954413 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.954310    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd" event={"ID":"6b262f9e-6d68-4a6f-8d00-7259b67b14b4","Type":"ContainerDied","Data":"9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f"}
Jul 10 21:22:37.954451 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.954424    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548b95f5c9-vlqqd" event={"ID":"6b262f9e-6d68-4a6f-8d00-7259b67b14b4","Type":"ContainerDied","Data":"42bf7d84114a370f84105fa7667cd6f4715a7d7c0743e5626472dd0d9f3a36ac"}
Jul 10 21:22:37.954451 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.954445    2575 scope.go:117] "RemoveContainer" containerID="9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f"
Jul 10 21:22:37.962776 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.962760    2575 scope.go:117] "RemoveContainer" containerID="9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f"
Jul 10 21:22:37.963040 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:22:37.963021    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f\": container with ID starting with 9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f not found: ID does not exist" containerID="9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f"
Jul 10 21:22:37.963090 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:37.963058    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f"} err="failed to get container status \"9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f\": rpc error: code = NotFound desc = could not find container \"9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f\": container with ID starting with 9cd801b358a9098561ddba5b54a6910c66965df1ee5a124cafb38bc98f1b7f6f not found: ID does not exist"
Jul 10 21:22:38.033462 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.033424    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-certificates\") pod \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") "
Jul 10 21:22:38.033462 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.033470    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-ca-trust-extracted\") pod \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") "
Jul 10 21:22:38.033675 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.033488    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-trusted-ca\") pod \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") "
Jul 10 21:22:38.033675 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.033523    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-image-registry-private-configuration\") pod \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") "
Jul 10 21:22:38.033675 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.033543    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-installation-pull-secrets\") pod \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") "
Jul 10 21:22:38.033675 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.033578    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfnj7\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-kube-api-access-rfnj7\") pod \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") "
Jul 10 21:22:38.033675 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.033614    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls\") pod \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") "
Jul 10 21:22:38.033675 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.033648    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-bound-sa-token\") pod \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\" (UID: \"6b262f9e-6d68-4a6f-8d00-7259b67b14b4\") "
Jul 10 21:22:38.033954 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.033889    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6b262f9e-6d68-4a6f-8d00-7259b67b14b4" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:22:38.034217 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.034187    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6b262f9e-6d68-4a6f-8d00-7259b67b14b4" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:22:38.036211 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.036151    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6b262f9e-6d68-4a6f-8d00-7259b67b14b4" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:22:38.036211 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.036165    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-kube-api-access-rfnj7" (OuterVolumeSpecName: "kube-api-access-rfnj7") pod "6b262f9e-6d68-4a6f-8d00-7259b67b14b4" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4"). InnerVolumeSpecName "kube-api-access-rfnj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:22:38.036410 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.036212    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6b262f9e-6d68-4a6f-8d00-7259b67b14b4" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:22:38.036410 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.036324    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6b262f9e-6d68-4a6f-8d00-7259b67b14b4" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:22:38.036519 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.036414    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6b262f9e-6d68-4a6f-8d00-7259b67b14b4" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:22:38.042449 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.042424    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6b262f9e-6d68-4a6f-8d00-7259b67b14b4" (UID: "6b262f9e-6d68-4a6f-8d00-7259b67b14b4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:22:38.134949 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.134867    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:22:38.134949 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.134897    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-bound-sa-token\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:22:38.134949 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.134907    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-registry-certificates\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:22:38.134949 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.134916    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-ca-trust-extracted\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:22:38.134949 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.134926    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-trusted-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:22:38.134949 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.134935    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-image-registry-private-configuration\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:22:38.134949 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.134943    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-installation-pull-secrets\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:22:38.134949 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.134952    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfnj7\" (UniqueName: \"kubernetes.io/projected/6b262f9e-6d68-4a6f-8d00-7259b67b14b4-kube-api-access-rfnj7\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:22:38.275798 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.275764    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-548b95f5c9-vlqqd"]
Jul 10 21:22:38.281459 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:38.281433    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-548b95f5c9-vlqqd"]
Jul 10 21:22:39.523157 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:39.523121    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b262f9e-6d68-4a6f-8d00-7259b67b14b4" path="/var/lib/kubelet/pods/6b262f9e-6d68-4a6f-8d00-7259b67b14b4/volumes"
Jul 10 21:22:39.990585 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:39.990545    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:40.069518 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:40.069477    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:41.141207 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:41.141173    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:41.242186 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:41.242145    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:41.970129 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:41.970098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b55677564-k5jms" event={"ID":"ec3a07fe-53c4-4e25-b4d8-102429d534d6","Type":"ContainerStarted","Data":"86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66"}
Jul 10 21:22:42.007188 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:42.007131    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b55677564-k5jms" podStartSLOduration=1.79930726 podStartE2EDuration="5.007113491s" totalImagesPullingTime="3.207806231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:42.0057903 +0000 UTC m=+87.639035559" watchObservedRunningTime="2026-07-10 21:22:42.007113491 +0000 UTC m=+87.640358744"
Jul 10 21:22:42.768137 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:42.768101    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:42.825963 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:42.825910    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:44.992659 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:44.992613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:45.091930 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:45.091882    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:46.369533 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:46.369504    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:46.470830 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:46.470782    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:47.675903 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:47.675874    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:47.676493 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:47.675954    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:47.680599 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:47.680578    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:47.943707 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:47.943596    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:47.999064 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:47.999038    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:22:48.031331 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:48.031289    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:49.094027 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:49.093993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:49.213705 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:49.213661    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:50.988400 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:50.988367    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:51.096507 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.096459    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:51.708693 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.708657    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9798d6b4f-8rj77"]
Jul 10 21:22:51.708962 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.708945    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b262f9e-6d68-4a6f-8d00-7259b67b14b4" containerName="registry"
Jul 10 21:22:51.709043 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.708964    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b262f9e-6d68-4a6f-8d00-7259b67b14b4" containerName="registry"
Jul 10 21:22:51.709097 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.709042    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b262f9e-6d68-4a6f-8d00-7259b67b14b4" containerName="registry"
Jul 10 21:22:51.717332 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.717251    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.726314 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.726287    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9798d6b4f-8rj77"]
Jul 10 21:22:51.774750 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.774712    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:51.842144 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.842109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:51.842144 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.842141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-config\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.842410 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.842165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-service-ca\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.842410 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.842226    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-oauth-config\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.842410 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.842259    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-serving-cert\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.842410 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.842308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plswk\" (UniqueName: \"kubernetes.io/projected/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-kube-api-access-plswk\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.842410 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.842358    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-trusted-ca-bundle\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.842410 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.842396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-oauth-serving-cert\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.943557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.943522    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-trusted-ca-bundle\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.943557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.943559    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-oauth-serving-cert\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.943767 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.943590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-config\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.943767 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.943657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-service-ca\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.943767 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.943727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-oauth-config\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.943912 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.943772    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-serving-cert\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.943912 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.943806    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plswk\" (UniqueName: \"kubernetes.io/projected/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-kube-api-access-plswk\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.944698 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.944656    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-config\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.944698 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.944672    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-service-ca\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.944871 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.944755    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-oauth-serving-cert\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.947489 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.947463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-oauth-config\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.949521 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.949332    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-trusted-ca-bundle\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.950591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.950529    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-serving-cert\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:51.952937 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:51.952916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plswk\" (UniqueName: \"kubernetes.io/projected/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-kube-api-access-plswk\") pod \"console-9798d6b4f-8rj77\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") " pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:52.026506 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:52.026421    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:22:52.155428 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:52.155379    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9798d6b4f-8rj77"]
Jul 10 21:22:52.158309 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:22:52.158283    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4cc722_5b97_40b6_b637_a6ef7a7c2129.slice/crio-cbcff3ca470169bf56ca88df1ead94c65bf82c4c935a18374049e5d1a8cd4e29 WatchSource:0}: Error finding container cbcff3ca470169bf56ca88df1ead94c65bf82c4c935a18374049e5d1a8cd4e29: Status 404 returned error can't find the container with id cbcff3ca470169bf56ca88df1ead94c65bf82c4c935a18374049e5d1a8cd4e29
Jul 10 21:22:53.013388 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:53.013355    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9798d6b4f-8rj77" event={"ID":"1c4cc722-5b97-40b6-b637-a6ef7a7c2129","Type":"ContainerStarted","Data":"3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd"}
Jul 10 21:22:53.013560 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:53.013404    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9798d6b4f-8rj77" event={"ID":"1c4cc722-5b97-40b6-b637-a6ef7a7c2129","Type":"ContainerStarted","Data":"cbcff3ca470169bf56ca88df1ead94c65bf82c4c935a18374049e5d1a8cd4e29"}
Jul 10 21:22:53.033383 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:53.033339    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9798d6b4f-8rj77" podStartSLOduration=2.033325117 podStartE2EDuration="2.033325117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:53.031304714 +0000 UTC m=+98.664549970" watchObservedRunningTime="2026-07-10 21:22:53.033325117 +0000 UTC m=+98.666570370"
Jul 10 21:22:53.670260 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:53.670220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:53.732204 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:53.732177    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:57.779925 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:57.779886    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:57.879622 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:57.879592    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:22:57.916761 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:22:57.916734    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4g72n"
Jul 10 21:23:02.026809 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:02.026771    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:23:02.027295 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:02.026831    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:23:02.031515 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:02.031492    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:23:02.047942 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:02.047921    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:23:02.097442 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:02.097412    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b55677564-k5jms"]
Jul 10 21:23:02.251747 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:02.251696    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:23:02.344893 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:02.344858    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:23:05.455936 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:05.455903    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:23:05.520128 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:05.520100    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:23:12.769867 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:12.769831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:23:12.844635 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:12.844599    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:23:27.117348 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.117146    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b55677564-k5jms" podUID="ec3a07fe-53c4-4e25-b4d8-102429d534d6" containerName="console" containerID="cri-o://86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66" gracePeriod=15
Jul 10 21:23:27.369996 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.369932    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:23:27.485761 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.485715    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-trusted-ca-bundle\") pod \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") "
Jul 10 21:23:27.485761 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.485771    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-oauth-config\") pod \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") "
Jul 10 21:23:27.486012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.485818    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-service-ca\") pod \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") "
Jul 10 21:23:27.486012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.485848    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rcdc\" (UniqueName: \"kubernetes.io/projected/ec3a07fe-53c4-4e25-b4d8-102429d534d6-kube-api-access-2rcdc\") pod \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") "
Jul 10 21:23:27.486012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.485873    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-config\") pod \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") "
Jul 10 21:23:27.486012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.485897    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-serving-cert\") pod \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") "
Jul 10 21:23:27.486012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.485923    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-oauth-serving-cert\") pod \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\" (UID: \"ec3a07fe-53c4-4e25-b4d8-102429d534d6\") "
Jul 10 21:23:27.486335 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.486255    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ec3a07fe-53c4-4e25-b4d8-102429d534d6" (UID: "ec3a07fe-53c4-4e25-b4d8-102429d534d6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:23:27.486487 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.486403    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-service-ca" (OuterVolumeSpecName: "service-ca") pod "ec3a07fe-53c4-4e25-b4d8-102429d534d6" (UID: "ec3a07fe-53c4-4e25-b4d8-102429d534d6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:23:27.486487 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.486426    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-config" (OuterVolumeSpecName: "console-config") pod "ec3a07fe-53c4-4e25-b4d8-102429d534d6" (UID: "ec3a07fe-53c4-4e25-b4d8-102429d534d6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:23:27.486487 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.486442    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ec3a07fe-53c4-4e25-b4d8-102429d534d6" (UID: "ec3a07fe-53c4-4e25-b4d8-102429d534d6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:23:27.488142 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.488116    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ec3a07fe-53c4-4e25-b4d8-102429d534d6" (UID: "ec3a07fe-53c4-4e25-b4d8-102429d534d6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:23:27.488205 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.488146    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec3a07fe-53c4-4e25-b4d8-102429d534d6-kube-api-access-2rcdc" (OuterVolumeSpecName: "kube-api-access-2rcdc") pod "ec3a07fe-53c4-4e25-b4d8-102429d534d6" (UID: "ec3a07fe-53c4-4e25-b4d8-102429d534d6"). InnerVolumeSpecName "kube-api-access-2rcdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:23:27.488241 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.488213    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ec3a07fe-53c4-4e25-b4d8-102429d534d6" (UID: "ec3a07fe-53c4-4e25-b4d8-102429d534d6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:23:27.586899 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.586865    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-config\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:23:27.586899 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.586893    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-serving-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:23:27.586899 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.586903    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-oauth-serving-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:23:27.586899 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.586912    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-trusted-ca-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:23:27.587147 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.586920    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec3a07fe-53c4-4e25-b4d8-102429d534d6-console-oauth-config\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:23:27.587147 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.586929    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3a07fe-53c4-4e25-b4d8-102429d534d6-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:23:27.587147 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:27.586937    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rcdc\" (UniqueName: \"kubernetes.io/projected/ec3a07fe-53c4-4e25-b4d8-102429d534d6-kube-api-access-2rcdc\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:23:28.130072 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:28.130036    2575 generic.go:356] "Generic (PLEG): container finished" podID="ec3a07fe-53c4-4e25-b4d8-102429d534d6" containerID="86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66" exitCode=0
Jul 10 21:23:28.130577 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:28.130083    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b55677564-k5jms"
Jul 10 21:23:28.130577 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:28.130115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b55677564-k5jms" event={"ID":"ec3a07fe-53c4-4e25-b4d8-102429d534d6","Type":"ContainerDied","Data":"86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66"}
Jul 10 21:23:28.130577 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:28.130165    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b55677564-k5jms" event={"ID":"ec3a07fe-53c4-4e25-b4d8-102429d534d6","Type":"ContainerDied","Data":"9fe8762b687a58f38c7eb35fba304c879ad042f39aff88a0ad308948b5155a25"}
Jul 10 21:23:28.130577 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:28.130188    2575 scope.go:117] "RemoveContainer" containerID="86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66"
Jul 10 21:23:28.137961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:28.137943    2575 scope.go:117] "RemoveContainer" containerID="86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66"
Jul 10 21:23:28.138251 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:23:28.138232    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66\": container with ID starting with 86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66 not found: ID does not exist" containerID="86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66"
Jul 10 21:23:28.138322 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:28.138260    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66"} err="failed to get container status \"86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66\": rpc error: code = NotFound desc = could not find container \"86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66\": container with ID starting with 86e7221b238b98c4e1d766e9c633cf4e54b10bc8a12df66de4009acb172e4a66 not found: ID does not exist"
Jul 10 21:23:28.145862 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:28.145837    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b55677564-k5jms"]
Jul 10 21:23:28.150190 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:28.150167    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b55677564-k5jms"]
Jul 10 21:23:29.521306 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:29.521258    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec3a07fe-53c4-4e25-b4d8-102429d534d6" path="/var/lib/kubelet/pods/ec3a07fe-53c4-4e25-b4d8-102429d534d6/volumes"
Jul 10 21:23:44.751176 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:44.751087    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:23:44.852977 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:44.852939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:23:56.697901 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:56.697865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:23:56.751303 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:23:56.751259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:12.787883 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:12.787791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:12.885834 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:12.885785    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:16.887643 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:16.887612    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69588d6b5-jtgpl"]
Jul 10 21:24:16.888004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:16.887830    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3a07fe-53c4-4e25-b4d8-102429d534d6" containerName="console"
Jul 10 21:24:16.888004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:16.887840    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3a07fe-53c4-4e25-b4d8-102429d534d6" containerName="console"
Jul 10 21:24:16.888004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:16.887888    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec3a07fe-53c4-4e25-b4d8-102429d534d6" containerName="console"
Jul 10 21:24:16.890741 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:16.890724    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:16.901512 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:16.901488    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69588d6b5-jtgpl"]
Jul 10 21:24:16.950677 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:16.950643    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:17.022811 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.022764    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:17.028130 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.028105    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66490324-217b-44f7-84e2-02fafa30d484-console-oauth-config\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.028252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.028143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66490324-217b-44f7-84e2-02fafa30d484-console-serving-cert\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.028252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.028171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-console-config\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.028252 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.028195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-trusted-ca-bundle\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.028384 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.028307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px5p7\" (UniqueName: \"kubernetes.io/projected/66490324-217b-44f7-84e2-02fafa30d484-kube-api-access-px5p7\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.028384 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.028329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-oauth-serving-cert\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.028471 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.028391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-service-ca\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.129261 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.129201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-service-ca\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.129459 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.129388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66490324-217b-44f7-84e2-02fafa30d484-console-oauth-config\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.129459 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.129439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66490324-217b-44f7-84e2-02fafa30d484-console-serving-cert\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.129581 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.129470    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-console-config\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.129581 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.129493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-trusted-ca-bundle\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.129581 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.129543    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px5p7\" (UniqueName: \"kubernetes.io/projected/66490324-217b-44f7-84e2-02fafa30d484-kube-api-access-px5p7\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.129581 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.129575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-oauth-serving-cert\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.130055 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.130025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-service-ca\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.130175 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.130132    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-console-config\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.130329 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.130307    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-trusted-ca-bundle\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.130411 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.130312    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-oauth-serving-cert\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.131818 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.131791    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66490324-217b-44f7-84e2-02fafa30d484-console-oauth-config\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.132042 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.132024    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66490324-217b-44f7-84e2-02fafa30d484-console-serving-cert\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.139082 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.139030    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px5p7\" (UniqueName: \"kubernetes.io/projected/66490324-217b-44f7-84e2-02fafa30d484-kube-api-access-px5p7\") pod \"console-69588d6b5-jtgpl\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") " pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.199139 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.199105    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:17.331618 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:17.331587    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69588d6b5-jtgpl"]
Jul 10 21:24:17.334476 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:24:17.334448    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66490324_217b_44f7_84e2_02fafa30d484.slice/crio-5faad587ede0de9c44db58f1e17646e2ee901fe7d9b5a6c877048eaea1e11359 WatchSource:0}: Error finding container 5faad587ede0de9c44db58f1e17646e2ee901fe7d9b5a6c877048eaea1e11359: Status 404 returned error can't find the container with id 5faad587ede0de9c44db58f1e17646e2ee901fe7d9b5a6c877048eaea1e11359
Jul 10 21:24:18.302751 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:18.302714    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69588d6b5-jtgpl" event={"ID":"66490324-217b-44f7-84e2-02fafa30d484","Type":"ContainerStarted","Data":"8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6"}
Jul 10 21:24:18.303336 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:18.302762    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69588d6b5-jtgpl" event={"ID":"66490324-217b-44f7-84e2-02fafa30d484","Type":"ContainerStarted","Data":"5faad587ede0de9c44db58f1e17646e2ee901fe7d9b5a6c877048eaea1e11359"}
Jul 10 21:24:18.320876 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:18.320824    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69588d6b5-jtgpl" podStartSLOduration=2.320806681 podStartE2EDuration="2.320806681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:24:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:24:18.319041955 +0000 UTC m=+183.952287209" watchObservedRunningTime="2026-07-10 21:24:18.320806681 +0000 UTC m=+183.954051934"
Jul 10 21:24:27.200015 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:27.199972    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:27.200455 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:27.200312    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:27.204945 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:27.204920    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:27.336961 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:27.336934    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:24:27.386082 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:27.386046    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9798d6b4f-8rj77"]
Jul 10 21:24:27.524150 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:27.524066    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:27.625404 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:27.625362    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:27.726343 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:27.726309    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:27.783666 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:27.783584    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:35.357582 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:35.357549    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:35.416732 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:35.416704    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:42.515854 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:42.515814    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:42.617014 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:42.616983    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:24:43.137640 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.137602    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"]
Jul 10 21:24:43.140627 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.140602    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:24:43.143603 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.143572    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 21:24:43.144520 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.144495    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8pdnx\""
Jul 10 21:24:43.144633 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.144495    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 21:24:43.151312 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.151264    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"]
Jul 10 21:24:43.227399 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.227347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjdnp\" (UniqueName: \"kubernetes.io/projected/818bcb2d-7217-4f54-8219-38ec7b074bb2-kube-api-access-tjdnp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8\" (UID: \"818bcb2d-7217-4f54-8219-38ec7b074bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:24:43.227399 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.227403    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/818bcb2d-7217-4f54-8219-38ec7b074bb2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8\" (UID: \"818bcb2d-7217-4f54-8219-38ec7b074bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:24:43.227624 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.227454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/818bcb2d-7217-4f54-8219-38ec7b074bb2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8\" (UID: \"818bcb2d-7217-4f54-8219-38ec7b074bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:24:43.328066 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.327942    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjdnp\" (UniqueName: \"kubernetes.io/projected/818bcb2d-7217-4f54-8219-38ec7b074bb2-kube-api-access-tjdnp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8\" (UID: \"818bcb2d-7217-4f54-8219-38ec7b074bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:24:43.328176 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.328095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/818bcb2d-7217-4f54-8219-38ec7b074bb2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8\" (UID: \"818bcb2d-7217-4f54-8219-38ec7b074bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:24:43.328176 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.328124    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/818bcb2d-7217-4f54-8219-38ec7b074bb2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8\" (UID: \"818bcb2d-7217-4f54-8219-38ec7b074bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:24:43.328501 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.328485    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/818bcb2d-7217-4f54-8219-38ec7b074bb2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8\" (UID: \"818bcb2d-7217-4f54-8219-38ec7b074bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:24:43.328539 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.328512    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/818bcb2d-7217-4f54-8219-38ec7b074bb2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8\" (UID: \"818bcb2d-7217-4f54-8219-38ec7b074bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:24:43.336836 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.336800    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjdnp\" (UniqueName: \"kubernetes.io/projected/818bcb2d-7217-4f54-8219-38ec7b074bb2-kube-api-access-tjdnp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8\" (UID: \"818bcb2d-7217-4f54-8219-38ec7b074bb2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:24:43.450642 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.450555    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:24:43.582590 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:43.581550    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"]
Jul 10 21:24:43.587759 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:24:43.587734    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818bcb2d_7217_4f54_8219_38ec7b074bb2.slice/crio-316533d3089888ff5538537ba896e8d9ac9900c7d19fd35dabf8af7e898a07d0 WatchSource:0}: Error finding container 316533d3089888ff5538537ba896e8d9ac9900c7d19fd35dabf8af7e898a07d0: Status 404 returned error can't find the container with id 316533d3089888ff5538537ba896e8d9ac9900c7d19fd35dabf8af7e898a07d0
Jul 10 21:24:44.388672 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:44.388633    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8" event={"ID":"818bcb2d-7217-4f54-8219-38ec7b074bb2","Type":"ContainerStarted","Data":"316533d3089888ff5538537ba896e8d9ac9900c7d19fd35dabf8af7e898a07d0"}
Jul 10 21:24:50.411851 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:50.411823    2575 generic.go:356] "Generic (PLEG): container finished" podID="818bcb2d-7217-4f54-8219-38ec7b074bb2" containerID="d12af5a444008d1ba6d8d660223f2ff904a7b6e851cf7de9d4e1da2f71b1a51f" exitCode=0
Jul 10 21:24:50.412243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:50.411887    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8" event={"ID":"818bcb2d-7217-4f54-8219-38ec7b074bb2","Type":"ContainerDied","Data":"d12af5a444008d1ba6d8d660223f2ff904a7b6e851cf7de9d4e1da2f71b1a51f"}
Jul 10 21:24:52.412855 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.412805    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9798d6b4f-8rj77" podUID="1c4cc722-5b97-40b6-b637-a6ef7a7c2129" containerName="console" containerID="cri-o://3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd" gracePeriod=15
Jul 10 21:24:52.423461 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.423436    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8" event={"ID":"818bcb2d-7217-4f54-8219-38ec7b074bb2","Type":"ContainerStarted","Data":"cbf6e3e6b3317572ac6d3cbd3cea76daa919142db25b14d401bfd464aef0f98b"}
Jul 10 21:24:52.649714 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.649690    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:24:52.702198 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.702163    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-config\") pod \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") "
Jul 10 21:24:52.702421 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.702207    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-oauth-config\") pod \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") "
Jul 10 21:24:52.702421 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.702226    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plswk\" (UniqueName: \"kubernetes.io/projected/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-kube-api-access-plswk\") pod \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") "
Jul 10 21:24:52.702421 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.702260    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-serving-cert\") pod \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") "
Jul 10 21:24:52.702421 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.702316    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-trusted-ca-bundle\") pod \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") "
Jul 10 21:24:52.702421 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.702332    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-oauth-serving-cert\") pod \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") "
Jul 10 21:24:52.702421 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.702359    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-service-ca\") pod \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\" (UID: \"1c4cc722-5b97-40b6-b637-a6ef7a7c2129\") "
Jul 10 21:24:52.702774 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.702739    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-config" (OuterVolumeSpecName: "console-config") pod "1c4cc722-5b97-40b6-b637-a6ef7a7c2129" (UID: "1c4cc722-5b97-40b6-b637-a6ef7a7c2129"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:24:52.702894 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.702839    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-service-ca" (OuterVolumeSpecName: "service-ca") pod "1c4cc722-5b97-40b6-b637-a6ef7a7c2129" (UID: "1c4cc722-5b97-40b6-b637-a6ef7a7c2129"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:24:52.702894 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.702866    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1c4cc722-5b97-40b6-b637-a6ef7a7c2129" (UID: "1c4cc722-5b97-40b6-b637-a6ef7a7c2129"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:24:52.702968 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.702903    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1c4cc722-5b97-40b6-b637-a6ef7a7c2129" (UID: "1c4cc722-5b97-40b6-b637-a6ef7a7c2129"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:24:52.704537 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.704517    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1c4cc722-5b97-40b6-b637-a6ef7a7c2129" (UID: "1c4cc722-5b97-40b6-b637-a6ef7a7c2129"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:24:52.704915 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.704888    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1c4cc722-5b97-40b6-b637-a6ef7a7c2129" (UID: "1c4cc722-5b97-40b6-b637-a6ef7a7c2129"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:24:52.704915 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.704889    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-kube-api-access-plswk" (OuterVolumeSpecName: "kube-api-access-plswk") pod "1c4cc722-5b97-40b6-b637-a6ef7a7c2129" (UID: "1c4cc722-5b97-40b6-b637-a6ef7a7c2129"). InnerVolumeSpecName "kube-api-access-plswk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:24:52.802928 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.802881    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-trusted-ca-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:24:52.802928 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.802920    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-oauth-serving-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:24:52.802928 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.802930    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:24:52.802928 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.802940    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-config\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:24:52.802928 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.802949    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-oauth-config\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:24:52.803218 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.802957    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plswk\" (UniqueName: \"kubernetes.io/projected/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-kube-api-access-plswk\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:24:52.803218 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:52.802965    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c4cc722-5b97-40b6-b637-a6ef7a7c2129-console-serving-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:24:53.428434 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:53.428402    2575 generic.go:356] "Generic (PLEG): container finished" podID="1c4cc722-5b97-40b6-b637-a6ef7a7c2129" containerID="3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd" exitCode=0
Jul 10 21:24:53.428850 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:53.428451    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9798d6b4f-8rj77"
Jul 10 21:24:53.428850 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:53.428491    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9798d6b4f-8rj77" event={"ID":"1c4cc722-5b97-40b6-b637-a6ef7a7c2129","Type":"ContainerDied","Data":"3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd"}
Jul 10 21:24:53.428850 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:53.428552    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9798d6b4f-8rj77" event={"ID":"1c4cc722-5b97-40b6-b637-a6ef7a7c2129","Type":"ContainerDied","Data":"cbcff3ca470169bf56ca88df1ead94c65bf82c4c935a18374049e5d1a8cd4e29"}
Jul 10 21:24:53.428850 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:53.428580    2575 scope.go:117] "RemoveContainer" containerID="3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd"
Jul 10 21:24:53.430473 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:53.430452    2575 generic.go:356] "Generic (PLEG): container finished" podID="818bcb2d-7217-4f54-8219-38ec7b074bb2" containerID="cbf6e3e6b3317572ac6d3cbd3cea76daa919142db25b14d401bfd464aef0f98b" exitCode=0
Jul 10 21:24:53.430564 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:53.430511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8" event={"ID":"818bcb2d-7217-4f54-8219-38ec7b074bb2","Type":"ContainerDied","Data":"cbf6e3e6b3317572ac6d3cbd3cea76daa919142db25b14d401bfd464aef0f98b"}
Jul 10 21:24:53.436942 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:53.436924    2575 scope.go:117] "RemoveContainer" containerID="3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd"
Jul 10 21:24:53.437202 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:24:53.437182    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd\": container with ID starting with 3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd not found: ID does not exist" containerID="3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd"
Jul 10 21:24:53.437265 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:53.437211    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd"} err="failed to get container status \"3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd\": rpc error: code = NotFound desc = could not find container \"3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd\": container with ID starting with 3fea909b697670c90667c5750058cd0c742c6c9812135d2598ec4d675be34bdd not found: ID does not exist"
Jul 10 21:24:53.460843 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:53.460810    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9798d6b4f-8rj77"]
Jul 10 21:24:53.465106 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:53.465079    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9798d6b4f-8rj77"]
Jul 10 21:24:53.522151 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:24:53.522118    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c4cc722-5b97-40b6-b637-a6ef7a7c2129" path="/var/lib/kubelet/pods/1c4cc722-5b97-40b6-b637-a6ef7a7c2129/volumes"
Jul 10 21:25:01.467491 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:01.467454    2575 generic.go:356] "Generic (PLEG): container finished" podID="818bcb2d-7217-4f54-8219-38ec7b074bb2" containerID="2afee09ebc40c4ed03b07df69486e94d9d14f4eca9463bc816805d4f52fcecb4" exitCode=0
Jul 10 21:25:01.467859 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:01.467513    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8" event={"ID":"818bcb2d-7217-4f54-8219-38ec7b074bb2","Type":"ContainerDied","Data":"2afee09ebc40c4ed03b07df69486e94d9d14f4eca9463bc816805d4f52fcecb4"}
Jul 10 21:25:02.605765 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:02.605726    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:25:02.675781 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:02.675732    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjdnp\" (UniqueName: \"kubernetes.io/projected/818bcb2d-7217-4f54-8219-38ec7b074bb2-kube-api-access-tjdnp\") pod \"818bcb2d-7217-4f54-8219-38ec7b074bb2\" (UID: \"818bcb2d-7217-4f54-8219-38ec7b074bb2\") "
Jul 10 21:25:02.675781 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:02.675790    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/818bcb2d-7217-4f54-8219-38ec7b074bb2-bundle\") pod \"818bcb2d-7217-4f54-8219-38ec7b074bb2\" (UID: \"818bcb2d-7217-4f54-8219-38ec7b074bb2\") "
Jul 10 21:25:02.676037 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:02.675809    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/818bcb2d-7217-4f54-8219-38ec7b074bb2-util\") pod \"818bcb2d-7217-4f54-8219-38ec7b074bb2\" (UID: \"818bcb2d-7217-4f54-8219-38ec7b074bb2\") "
Jul 10 21:25:02.676470 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:02.676445    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/818bcb2d-7217-4f54-8219-38ec7b074bb2-bundle" (OuterVolumeSpecName: "bundle") pod "818bcb2d-7217-4f54-8219-38ec7b074bb2" (UID: "818bcb2d-7217-4f54-8219-38ec7b074bb2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:25:02.678033 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:02.678011    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/818bcb2d-7217-4f54-8219-38ec7b074bb2-kube-api-access-tjdnp" (OuterVolumeSpecName: "kube-api-access-tjdnp") pod "818bcb2d-7217-4f54-8219-38ec7b074bb2" (UID: "818bcb2d-7217-4f54-8219-38ec7b074bb2"). InnerVolumeSpecName "kube-api-access-tjdnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:25:02.680080 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:02.680061    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/818bcb2d-7217-4f54-8219-38ec7b074bb2-util" (OuterVolumeSpecName: "util") pod "818bcb2d-7217-4f54-8219-38ec7b074bb2" (UID: "818bcb2d-7217-4f54-8219-38ec7b074bb2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:25:02.777243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:02.777149    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjdnp\" (UniqueName: \"kubernetes.io/projected/818bcb2d-7217-4f54-8219-38ec7b074bb2-kube-api-access-tjdnp\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:25:02.777243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:02.777204    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/818bcb2d-7217-4f54-8219-38ec7b074bb2-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:25:02.777243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:02.777213    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/818bcb2d-7217-4f54-8219-38ec7b074bb2-util\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:25:03.475544 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:03.475517    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8"
Jul 10 21:25:03.475544 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:03.475530    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540695p8" event={"ID":"818bcb2d-7217-4f54-8219-38ec7b074bb2","Type":"ContainerDied","Data":"316533d3089888ff5538537ba896e8d9ac9900c7d19fd35dabf8af7e898a07d0"}
Jul 10 21:25:03.475732 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:03.475574    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="316533d3089888ff5538537ba896e8d9ac9900c7d19fd35dabf8af7e898a07d0"
Jul 10 21:25:09.413316 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:09.413237    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:10.798613 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:10.798582    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:11.367894 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.367855    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4"]
Jul 10 21:25:11.368108 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.368096    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4cc722-5b97-40b6-b637-a6ef7a7c2129" containerName="console"
Jul 10 21:25:11.368150 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.368111    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4cc722-5b97-40b6-b637-a6ef7a7c2129" containerName="console"
Jul 10 21:25:11.368150 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.368119    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="818bcb2d-7217-4f54-8219-38ec7b074bb2" containerName="pull"
Jul 10 21:25:11.368150 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.368124    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="818bcb2d-7217-4f54-8219-38ec7b074bb2" containerName="pull"
Jul 10 21:25:11.368150 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.368130    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="818bcb2d-7217-4f54-8219-38ec7b074bb2" containerName="extract"
Jul 10 21:25:11.368150 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.368137    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="818bcb2d-7217-4f54-8219-38ec7b074bb2" containerName="extract"
Jul 10 21:25:11.368315 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.368152    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="818bcb2d-7217-4f54-8219-38ec7b074bb2" containerName="util"
Jul 10 21:25:11.368315 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.368160    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="818bcb2d-7217-4f54-8219-38ec7b074bb2" containerName="util"
Jul 10 21:25:11.368315 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.368203    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c4cc722-5b97-40b6-b637-a6ef7a7c2129" containerName="console"
Jul 10 21:25:11.368315 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.368209    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="818bcb2d-7217-4f54-8219-38ec7b074bb2" containerName="extract"
Jul 10 21:25:11.370002 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.369987    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4"
Jul 10 21:25:11.372905 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.372885    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rpdnm\""
Jul 10 21:25:11.373129 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.373109    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 10 21:25:11.373206 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.373182    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 10 21:25:11.388599 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.388573    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4"]
Jul 10 21:25:11.437070 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.437030    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfnrv\" (UniqueName: \"kubernetes.io/projected/808af5cd-1a90-478d-94ab-66dd1e733779-kube-api-access-cfnrv\") pod \"cert-manager-operator-controller-manager-55c444bf86-vxjz4\" (UID: \"808af5cd-1a90-478d-94ab-66dd1e733779\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4"
Jul 10 21:25:11.437070 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.437074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/808af5cd-1a90-478d-94ab-66dd1e733779-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vxjz4\" (UID: \"808af5cd-1a90-478d-94ab-66dd1e733779\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4"
Jul 10 21:25:11.537551 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.537523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/808af5cd-1a90-478d-94ab-66dd1e733779-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vxjz4\" (UID: \"808af5cd-1a90-478d-94ab-66dd1e733779\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4"
Jul 10 21:25:11.537721 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.537592    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfnrv\" (UniqueName: \"kubernetes.io/projected/808af5cd-1a90-478d-94ab-66dd1e733779-kube-api-access-cfnrv\") pod \"cert-manager-operator-controller-manager-55c444bf86-vxjz4\" (UID: \"808af5cd-1a90-478d-94ab-66dd1e733779\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4"
Jul 10 21:25:11.537985 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.537961    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/808af5cd-1a90-478d-94ab-66dd1e733779-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vxjz4\" (UID: \"808af5cd-1a90-478d-94ab-66dd1e733779\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4"
Jul 10 21:25:11.546590 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.546567    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfnrv\" (UniqueName: \"kubernetes.io/projected/808af5cd-1a90-478d-94ab-66dd1e733779-kube-api-access-cfnrv\") pod \"cert-manager-operator-controller-manager-55c444bf86-vxjz4\" (UID: \"808af5cd-1a90-478d-94ab-66dd1e733779\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4"
Jul 10 21:25:11.678600 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.678512    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4"
Jul 10 21:25:11.806652 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:11.806620    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4"]
Jul 10 21:25:11.809827 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:25:11.809799    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808af5cd_1a90_478d_94ab_66dd1e733779.slice/crio-fdd315499de07fa857b97845f44de4df3f4a6e1012e7b447ef75a9124878f3b6 WatchSource:0}: Error finding container fdd315499de07fa857b97845f44de4df3f4a6e1012e7b447ef75a9124878f3b6: Status 404 returned error can't find the container with id fdd315499de07fa857b97845f44de4df3f4a6e1012e7b447ef75a9124878f3b6
Jul 10 21:25:12.507328 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:12.507297    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4" event={"ID":"808af5cd-1a90-478d-94ab-66dd1e733779","Type":"ContainerStarted","Data":"fdd315499de07fa857b97845f44de4df3f4a6e1012e7b447ef75a9124878f3b6"}
Jul 10 21:25:13.027173 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:13.027135    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:13.123916 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:13.123874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:14.516040 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:14.516002    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4" event={"ID":"808af5cd-1a90-478d-94ab-66dd1e733779","Type":"ContainerStarted","Data":"e6c97934e978ee65460f3dc99bee2ddc769d58ddddc09f05d2385a5222926d99"}
Jul 10 21:25:14.550518 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:14.550469    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxjz4" podStartSLOduration=1.563010356 podStartE2EDuration="3.550451893s" totalImagesPullingTime="1.987441537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:25:14.548014487 +0000 UTC m=+240.181259740" watchObservedRunningTime="2026-07-10 21:25:14.550451893 +0000 UTC m=+240.183697150"
Jul 10 21:25:14.976484 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:14.976439    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:15.144747 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.144713    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:15.663490 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.663404    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"]
Jul 10 21:25:15.666448 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.666426    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:15.669206 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.669184    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8pdnx\""
Jul 10 21:25:15.669335 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.669218    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 21:25:15.670388 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.670369    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 21:25:15.676945 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.676923    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"]
Jul 10 21:25:15.767131 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.767098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f90705d-154c-410f-8c99-32a03eabc5d8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh\" (UID: \"7f90705d-154c-410f-8c99-32a03eabc5d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:15.767131 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.767131    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f90705d-154c-410f-8c99-32a03eabc5d8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh\" (UID: \"7f90705d-154c-410f-8c99-32a03eabc5d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:15.767376 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.767158    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6h85\" (UniqueName: \"kubernetes.io/projected/7f90705d-154c-410f-8c99-32a03eabc5d8-kube-api-access-x6h85\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh\" (UID: \"7f90705d-154c-410f-8c99-32a03eabc5d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:15.867656 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.867628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f90705d-154c-410f-8c99-32a03eabc5d8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh\" (UID: \"7f90705d-154c-410f-8c99-32a03eabc5d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:15.867656 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.867659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f90705d-154c-410f-8c99-32a03eabc5d8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh\" (UID: \"7f90705d-154c-410f-8c99-32a03eabc5d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:15.867915 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.867686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6h85\" (UniqueName: \"kubernetes.io/projected/7f90705d-154c-410f-8c99-32a03eabc5d8-kube-api-access-x6h85\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh\" (UID: \"7f90705d-154c-410f-8c99-32a03eabc5d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:15.868020 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.867996    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f90705d-154c-410f-8c99-32a03eabc5d8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh\" (UID: \"7f90705d-154c-410f-8c99-32a03eabc5d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:15.868103 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.868077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f90705d-154c-410f-8c99-32a03eabc5d8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh\" (UID: \"7f90705d-154c-410f-8c99-32a03eabc5d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:15.879572 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.879539    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6h85\" (UniqueName: \"kubernetes.io/projected/7f90705d-154c-410f-8c99-32a03eabc5d8-kube-api-access-x6h85\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh\" (UID: \"7f90705d-154c-410f-8c99-32a03eabc5d8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:15.974799 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:15.974710    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:16.103095 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:16.103065    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"]
Jul 10 21:25:16.106618 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:25:16.106589    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f90705d_154c_410f_8c99_32a03eabc5d8.slice/crio-2c5b9bb4f079d302c17e7dc4050f8245a2f001f2f4c6664253afafb08d05365a WatchSource:0}: Error finding container 2c5b9bb4f079d302c17e7dc4050f8245a2f001f2f4c6664253afafb08d05365a: Status 404 returned error can't find the container with id 2c5b9bb4f079d302c17e7dc4050f8245a2f001f2f4c6664253afafb08d05365a
Jul 10 21:25:16.453589 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:16.453557    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:16.524308 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:16.524259    2575 generic.go:356] "Generic (PLEG): container finished" podID="7f90705d-154c-410f-8c99-32a03eabc5d8" containerID="04d0928f1f88f14cfdc5724c72895f32910ce9fd68d20352c6fd8f312c02f81c" exitCode=0
Jul 10 21:25:16.524452 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:16.524308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh" event={"ID":"7f90705d-154c-410f-8c99-32a03eabc5d8","Type":"ContainerDied","Data":"04d0928f1f88f14cfdc5724c72895f32910ce9fd68d20352c6fd8f312c02f81c"}
Jul 10 21:25:16.524452 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:16.524357    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh" event={"ID":"7f90705d-154c-410f-8c99-32a03eabc5d8","Type":"ContainerStarted","Data":"2c5b9bb4f079d302c17e7dc4050f8245a2f001f2f4c6664253afafb08d05365a"}
Jul 10 21:25:17.499190 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:17.499131    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:17.711994 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:17.711951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:18.532746 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:18.532712    2575 generic.go:356] "Generic (PLEG): container finished" podID="7f90705d-154c-410f-8c99-32a03eabc5d8" containerID="383e9a4ee33660aa7f4ce5535b94320762d9c83ff4276960ff445369cdc36270" exitCode=0
Jul 10 21:25:18.533098 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:18.532773    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh" event={"ID":"7f90705d-154c-410f-8c99-32a03eabc5d8","Type":"ContainerDied","Data":"383e9a4ee33660aa7f4ce5535b94320762d9c83ff4276960ff445369cdc36270"}
Jul 10 21:25:19.537542 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:19.537505    2575 generic.go:356] "Generic (PLEG): container finished" podID="7f90705d-154c-410f-8c99-32a03eabc5d8" containerID="0cbbb7aadbd65f0f9d96155eeb6857cd5d969544a622438e2ab81d05a0ead49d" exitCode=0
Jul 10 21:25:19.537986 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:19.537565    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh" event={"ID":"7f90705d-154c-410f-8c99-32a03eabc5d8","Type":"ContainerDied","Data":"0cbbb7aadbd65f0f9d96155eeb6857cd5d969544a622438e2ab81d05a0ead49d"}
Jul 10 21:25:20.019128 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:20.019094    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:20.117873 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:20.117831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:20.660033 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:20.660010    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:20.706606 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:20.706574    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f90705d-154c-410f-8c99-32a03eabc5d8-util\") pod \"7f90705d-154c-410f-8c99-32a03eabc5d8\" (UID: \"7f90705d-154c-410f-8c99-32a03eabc5d8\") "
Jul 10 21:25:20.706768 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:20.706631    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6h85\" (UniqueName: \"kubernetes.io/projected/7f90705d-154c-410f-8c99-32a03eabc5d8-kube-api-access-x6h85\") pod \"7f90705d-154c-410f-8c99-32a03eabc5d8\" (UID: \"7f90705d-154c-410f-8c99-32a03eabc5d8\") "
Jul 10 21:25:20.706768 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:20.706655    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f90705d-154c-410f-8c99-32a03eabc5d8-bundle\") pod \"7f90705d-154c-410f-8c99-32a03eabc5d8\" (UID: \"7f90705d-154c-410f-8c99-32a03eabc5d8\") "
Jul 10 21:25:20.707118 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:20.707088    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f90705d-154c-410f-8c99-32a03eabc5d8-bundle" (OuterVolumeSpecName: "bundle") pod "7f90705d-154c-410f-8c99-32a03eabc5d8" (UID: "7f90705d-154c-410f-8c99-32a03eabc5d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:25:20.708729 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:20.708705    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f90705d-154c-410f-8c99-32a03eabc5d8-kube-api-access-x6h85" (OuterVolumeSpecName: "kube-api-access-x6h85") pod "7f90705d-154c-410f-8c99-32a03eabc5d8" (UID: "7f90705d-154c-410f-8c99-32a03eabc5d8"). InnerVolumeSpecName "kube-api-access-x6h85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:25:20.712402 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:20.712378    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f90705d-154c-410f-8c99-32a03eabc5d8-util" (OuterVolumeSpecName: "util") pod "7f90705d-154c-410f-8c99-32a03eabc5d8" (UID: "7f90705d-154c-410f-8c99-32a03eabc5d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:25:20.807287 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:20.807191    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f90705d-154c-410f-8c99-32a03eabc5d8-util\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:25:20.807287 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:20.807221    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6h85\" (UniqueName: \"kubernetes.io/projected/7f90705d-154c-410f-8c99-32a03eabc5d8-kube-api-access-x6h85\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:25:20.807287 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:20.807233    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f90705d-154c-410f-8c99-32a03eabc5d8-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:25:21.546390 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:21.546365    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh"
Jul 10 21:25:21.546390 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:21.546386    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdqkvh" event={"ID":"7f90705d-154c-410f-8c99-32a03eabc5d8","Type":"ContainerDied","Data":"2c5b9bb4f079d302c17e7dc4050f8245a2f001f2f4c6664253afafb08d05365a"}
Jul 10 21:25:21.546570 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:21.546427    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c5b9bb4f079d302c17e7dc4050f8245a2f001f2f4c6664253afafb08d05365a"
Jul 10 21:25:23.463583 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.463550    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl"]
Jul 10 21:25:23.463977 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.463770    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f90705d-154c-410f-8c99-32a03eabc5d8" containerName="extract"
Jul 10 21:25:23.463977 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.463780    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f90705d-154c-410f-8c99-32a03eabc5d8" containerName="extract"
Jul 10 21:25:23.463977 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.463790    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f90705d-154c-410f-8c99-32a03eabc5d8" containerName="pull"
Jul 10 21:25:23.463977 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.463796    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f90705d-154c-410f-8c99-32a03eabc5d8" containerName="pull"
Jul 10 21:25:23.463977 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.463803    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f90705d-154c-410f-8c99-32a03eabc5d8" containerName="util"
Jul 10 21:25:23.463977 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.463808    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f90705d-154c-410f-8c99-32a03eabc5d8" containerName="util"
Jul 10 21:25:23.463977 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.463859    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f90705d-154c-410f-8c99-32a03eabc5d8" containerName="extract"
Jul 10 21:25:23.465625 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.465608    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl"
Jul 10 21:25:23.468261 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.468240    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 21:25:23.468400 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.468261    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 21:25:23.468400 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.468245    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hrk8l\""
Jul 10 21:25:23.477454 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.477424    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl"]
Jul 10 21:25:23.526632 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.526595    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3427b7c1-1cbd-495f-85d3-ebd52ab3e73f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d8lkl\" (UID: \"3427b7c1-1cbd-495f-85d3-ebd52ab3e73f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl"
Jul 10 21:25:23.526632 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.526636    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsfww\" (UniqueName: \"kubernetes.io/projected/3427b7c1-1cbd-495f-85d3-ebd52ab3e73f-kube-api-access-xsfww\") pod \"cert-manager-cainjector-559cdd8c87-d8lkl\" (UID: \"3427b7c1-1cbd-495f-85d3-ebd52ab3e73f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl"
Jul 10 21:25:23.627545 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.627506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3427b7c1-1cbd-495f-85d3-ebd52ab3e73f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d8lkl\" (UID: \"3427b7c1-1cbd-495f-85d3-ebd52ab3e73f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl"
Jul 10 21:25:23.627545 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.627545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsfww\" (UniqueName: \"kubernetes.io/projected/3427b7c1-1cbd-495f-85d3-ebd52ab3e73f-kube-api-access-xsfww\") pod \"cert-manager-cainjector-559cdd8c87-d8lkl\" (UID: \"3427b7c1-1cbd-495f-85d3-ebd52ab3e73f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl"
Jul 10 21:25:23.635358 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.635331    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3427b7c1-1cbd-495f-85d3-ebd52ab3e73f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d8lkl\" (UID: \"3427b7c1-1cbd-495f-85d3-ebd52ab3e73f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl"
Jul 10 21:25:23.635470 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.635418    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsfww\" (UniqueName: \"kubernetes.io/projected/3427b7c1-1cbd-495f-85d3-ebd52ab3e73f-kube-api-access-xsfww\") pod \"cert-manager-cainjector-559cdd8c87-d8lkl\" (UID: \"3427b7c1-1cbd-495f-85d3-ebd52ab3e73f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl"
Jul 10 21:25:23.774570 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.774486    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl"
Jul 10 21:25:23.898391 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:23.898319    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl"]
Jul 10 21:25:23.900899 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:25:23.900864    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3427b7c1_1cbd_495f_85d3_ebd52ab3e73f.slice/crio-a9cecef8611b4bc2e05bb9024fae9f3e85916716fd0ee5352e79a3f644544b59 WatchSource:0}: Error finding container a9cecef8611b4bc2e05bb9024fae9f3e85916716fd0ee5352e79a3f644544b59: Status 404 returned error can't find the container with id a9cecef8611b4bc2e05bb9024fae9f3e85916716fd0ee5352e79a3f644544b59
Jul 10 21:25:24.557923 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:24.557889    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl" event={"ID":"3427b7c1-1cbd-495f-85d3-ebd52ab3e73f","Type":"ContainerStarted","Data":"a9cecef8611b4bc2e05bb9024fae9f3e85916716fd0ee5352e79a3f644544b59"}
Jul 10 21:25:24.713213 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:24.713177    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:26.433923 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:26.433890    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:26.531619 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:26.531581    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:27.305208 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:27.305169    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:27.366832 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:27.366793    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:27.572421 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:27.572334    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl" event={"ID":"3427b7c1-1cbd-495f-85d3-ebd52ab3e73f","Type":"ContainerStarted","Data":"4ce04e772d6989db78d246c1ce43e724b2d42cd620c46b17af52331ca3ae252e"}
Jul 10 21:25:27.595933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:27.595882    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lkl" podStartSLOduration=1.963486907 podStartE2EDuration="4.595867647s" totalImagesPullingTime="2.63238074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:25:27.595002156 +0000 UTC m=+253.228247415" watchObservedRunningTime="2026-07-10 21:25:27.595867647 +0000 UTC m=+253.229112901"
Jul 10 21:25:28.662592 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.662553    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb"]
Jul 10 21:25:28.664588 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.664566    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb"
Jul 10 21:25:28.667337 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.667308    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 21:25:28.667465 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.667447    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-926lf\""
Jul 10 21:25:28.668195 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.668183    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 21:25:28.675573 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.675547    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb"]
Jul 10 21:25:28.769306 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.769229    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g465g\" (UniqueName: \"kubernetes.io/projected/56c57172-8f41-43cd-bbb3-431807688de4-kube-api-access-g465g\") pod \"openshift-lws-operator-fd8ccff4c-z49xb\" (UID: \"56c57172-8f41-43cd-bbb3-431807688de4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb"
Jul 10 21:25:28.769482 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.769394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56c57172-8f41-43cd-bbb3-431807688de4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z49xb\" (UID: \"56c57172-8f41-43cd-bbb3-431807688de4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb"
Jul 10 21:25:28.869867 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.869831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56c57172-8f41-43cd-bbb3-431807688de4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z49xb\" (UID: \"56c57172-8f41-43cd-bbb3-431807688de4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb"
Jul 10 21:25:28.869982 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.869875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g465g\" (UniqueName: \"kubernetes.io/projected/56c57172-8f41-43cd-bbb3-431807688de4-kube-api-access-g465g\") pod \"openshift-lws-operator-fd8ccff4c-z49xb\" (UID: \"56c57172-8f41-43cd-bbb3-431807688de4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb"
Jul 10 21:25:28.870238 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.870217    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56c57172-8f41-43cd-bbb3-431807688de4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z49xb\" (UID: \"56c57172-8f41-43cd-bbb3-431807688de4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb"
Jul 10 21:25:28.878675 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.878646    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g465g\" (UniqueName: \"kubernetes.io/projected/56c57172-8f41-43cd-bbb3-431807688de4-kube-api-access-g465g\") pod \"openshift-lws-operator-fd8ccff4c-z49xb\" (UID: \"56c57172-8f41-43cd-bbb3-431807688de4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb"
Jul 10 21:25:28.973425 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:28.973348    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb"
Jul 10 21:25:29.100196 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:29.100163    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb"]
Jul 10 21:25:29.103220 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:25:29.103195    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56c57172_8f41_43cd_bbb3_431807688de4.slice/crio-558c884fca793f901643a3d552ad123d368054e2c44f002ceb48ee19f5073c75 WatchSource:0}: Error finding container 558c884fca793f901643a3d552ad123d368054e2c44f002ceb48ee19f5073c75: Status 404 returned error can't find the container with id 558c884fca793f901643a3d552ad123d368054e2c44f002ceb48ee19f5073c75
Jul 10 21:25:29.581794 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:29.581761    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb" event={"ID":"56c57172-8f41-43cd-bbb3-431807688de4","Type":"ContainerStarted","Data":"558c884fca793f901643a3d552ad123d368054e2c44f002ceb48ee19f5073c75"}
Jul 10 21:25:31.591816 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:31.591781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb" event={"ID":"56c57172-8f41-43cd-bbb3-431807688de4","Type":"ContainerStarted","Data":"5b23ca172777f5e16dfecebe08f29ac01d7e1be6ab7be0bde58913172949b01c"}
Jul 10 21:25:31.611143 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:31.611091    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z49xb" podStartSLOduration=1.79667747 podStartE2EDuration="3.611074023s" totalImagesPullingTime="1.814396553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:25:31.610511337 +0000 UTC m=+257.243756590" watchObservedRunningTime="2026-07-10 21:25:31.611074023 +0000 UTC m=+257.244319277"
Jul 10 21:25:32.334035 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:32.334006    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:32.434391 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:32.434358    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:34.048673 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:34.048634    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:36.207920 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.207707    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"]
Jul 10 21:25:36.210988 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.210958    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:36.213501 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.213481    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8pdnx\""
Jul 10 21:25:36.213683 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.213671    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 21:25:36.214303 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.214289    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 21:25:36.218572 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.218550    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"]
Jul 10 21:25:36.331531 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.331493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qt44\" (UniqueName: \"kubernetes.io/projected/5797620e-c049-45a9-972f-bd4eb36ac410-kube-api-access-2qt44\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf\" (UID: \"5797620e-c049-45a9-972f-bd4eb36ac410\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:36.331707 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.331553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5797620e-c049-45a9-972f-bd4eb36ac410-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf\" (UID: \"5797620e-c049-45a9-972f-bd4eb36ac410\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:36.331707 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.331611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5797620e-c049-45a9-972f-bd4eb36ac410-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf\" (UID: \"5797620e-c049-45a9-972f-bd4eb36ac410\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:36.432832 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.432793    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5797620e-c049-45a9-972f-bd4eb36ac410-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf\" (UID: \"5797620e-c049-45a9-972f-bd4eb36ac410\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:36.433031 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.432845    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qt44\" (UniqueName: \"kubernetes.io/projected/5797620e-c049-45a9-972f-bd4eb36ac410-kube-api-access-2qt44\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf\" (UID: \"5797620e-c049-45a9-972f-bd4eb36ac410\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:36.433031 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.432883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5797620e-c049-45a9-972f-bd4eb36ac410-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf\" (UID: \"5797620e-c049-45a9-972f-bd4eb36ac410\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:36.433263 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.433240    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5797620e-c049-45a9-972f-bd4eb36ac410-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf\" (UID: \"5797620e-c049-45a9-972f-bd4eb36ac410\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:36.433373 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.433302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5797620e-c049-45a9-972f-bd4eb36ac410-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf\" (UID: \"5797620e-c049-45a9-972f-bd4eb36ac410\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:36.443219 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.443195    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qt44\" (UniqueName: \"kubernetes.io/projected/5797620e-c049-45a9-972f-bd4eb36ac410-kube-api-access-2qt44\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf\" (UID: \"5797620e-c049-45a9-972f-bd4eb36ac410\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:36.520349 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.520249    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:36.650444 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:36.650348    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"]
Jul 10 21:25:36.653058 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:25:36.653029    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5797620e_c049_45a9_972f_bd4eb36ac410.slice/crio-27bc089604e0112818965edb61138c21aeb0e4e103536a4432afdb0c3b77e3b4 WatchSource:0}: Error finding container 27bc089604e0112818965edb61138c21aeb0e4e103536a4432afdb0c3b77e3b4: Status 404 returned error can't find the container with id 27bc089604e0112818965edb61138c21aeb0e4e103536a4432afdb0c3b77e3b4
Jul 10 21:25:37.617579 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:37.617541    2575 generic.go:356] "Generic (PLEG): container finished" podID="5797620e-c049-45a9-972f-bd4eb36ac410" containerID="4a181d8ac367d154b52d1a3e08537e9942c38ff3cfe83dc046dd13f8a0376bc8" exitCode=0
Jul 10 21:25:37.617959 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:37.617646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf" event={"ID":"5797620e-c049-45a9-972f-bd4eb36ac410","Type":"ContainerDied","Data":"4a181d8ac367d154b52d1a3e08537e9942c38ff3cfe83dc046dd13f8a0376bc8"}
Jul 10 21:25:37.617959 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:37.617711    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf" event={"ID":"5797620e-c049-45a9-972f-bd4eb36ac410","Type":"ContainerStarted","Data":"27bc089604e0112818965edb61138c21aeb0e4e103536a4432afdb0c3b77e3b4"}
Jul 10 21:25:38.623691 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:38.623659    2575 generic.go:356] "Generic (PLEG): container finished" podID="5797620e-c049-45a9-972f-bd4eb36ac410" containerID="567f60a5201ac95cf1d1a88f25cb738bca5b75e6723ecbd38ee676d5d32c6187" exitCode=0
Jul 10 21:25:38.624069 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:38.623717    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf" event={"ID":"5797620e-c049-45a9-972f-bd4eb36ac410","Type":"ContainerDied","Data":"567f60a5201ac95cf1d1a88f25cb738bca5b75e6723ecbd38ee676d5d32c6187"}
Jul 10 21:25:39.629327 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:39.629264    2575 generic.go:356] "Generic (PLEG): container finished" podID="5797620e-c049-45a9-972f-bd4eb36ac410" containerID="1ae2d194caf7669568a517458a97ce22001fa3dd759b63cc7725e0476e025c55" exitCode=0
Jul 10 21:25:39.629705 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:39.629331    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf" event={"ID":"5797620e-c049-45a9-972f-bd4eb36ac410","Type":"ContainerDied","Data":"1ae2d194caf7669568a517458a97ce22001fa3dd759b63cc7725e0476e025c55"}
Jul 10 21:25:40.755413 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:40.755388    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:40.866724 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:40.866651    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qt44\" (UniqueName: \"kubernetes.io/projected/5797620e-c049-45a9-972f-bd4eb36ac410-kube-api-access-2qt44\") pod \"5797620e-c049-45a9-972f-bd4eb36ac410\" (UID: \"5797620e-c049-45a9-972f-bd4eb36ac410\") "
Jul 10 21:25:40.866898 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:40.866776    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5797620e-c049-45a9-972f-bd4eb36ac410-bundle\") pod \"5797620e-c049-45a9-972f-bd4eb36ac410\" (UID: \"5797620e-c049-45a9-972f-bd4eb36ac410\") "
Jul 10 21:25:40.866898 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:40.866864    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5797620e-c049-45a9-972f-bd4eb36ac410-util\") pod \"5797620e-c049-45a9-972f-bd4eb36ac410\" (UID: \"5797620e-c049-45a9-972f-bd4eb36ac410\") "
Jul 10 21:25:40.867726 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:40.867698    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5797620e-c049-45a9-972f-bd4eb36ac410-bundle" (OuterVolumeSpecName: "bundle") pod "5797620e-c049-45a9-972f-bd4eb36ac410" (UID: "5797620e-c049-45a9-972f-bd4eb36ac410"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:25:40.869040 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:40.869009    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5797620e-c049-45a9-972f-bd4eb36ac410-kube-api-access-2qt44" (OuterVolumeSpecName: "kube-api-access-2qt44") pod "5797620e-c049-45a9-972f-bd4eb36ac410" (UID: "5797620e-c049-45a9-972f-bd4eb36ac410"). InnerVolumeSpecName "kube-api-access-2qt44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:25:40.872763 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:40.872725    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5797620e-c049-45a9-972f-bd4eb36ac410-util" (OuterVolumeSpecName: "util") pod "5797620e-c049-45a9-972f-bd4eb36ac410" (UID: "5797620e-c049-45a9-972f-bd4eb36ac410"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:25:40.968079 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:40.967995    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qt44\" (UniqueName: \"kubernetes.io/projected/5797620e-c049-45a9-972f-bd4eb36ac410-kube-api-access-2qt44\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:25:40.968079 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:40.968024    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5797620e-c049-45a9-972f-bd4eb36ac410-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:25:40.968079 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:40.968034    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5797620e-c049-45a9-972f-bd4eb36ac410-util\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:25:41.638610 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:41.638579    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf"
Jul 10 21:25:41.638610 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:41.638590    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd45lf" event={"ID":"5797620e-c049-45a9-972f-bd4eb36ac410","Type":"ContainerDied","Data":"27bc089604e0112818965edb61138c21aeb0e4e103536a4432afdb0c3b77e3b4"}
Jul 10 21:25:41.638850 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:41.638631    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27bc089604e0112818965edb61138c21aeb0e4e103536a4432afdb0c3b77e3b4"
Jul 10 21:25:47.134572 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:47.134532    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:47.282365 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:47.282329    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:47.705371 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:47.705337    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:48.007935 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.007858    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:48.111670 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.111638    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:48.138721 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.138688    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"]
Jul 10 21:25:48.139076 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.138929    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5797620e-c049-45a9-972f-bd4eb36ac410" containerName="extract"
Jul 10 21:25:48.139076 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.138939    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5797620e-c049-45a9-972f-bd4eb36ac410" containerName="extract"
Jul 10 21:25:48.139076 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.138948    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5797620e-c049-45a9-972f-bd4eb36ac410" containerName="util"
Jul 10 21:25:48.139076 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.138954    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5797620e-c049-45a9-972f-bd4eb36ac410" containerName="util"
Jul 10 21:25:48.139076 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.138961    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5797620e-c049-45a9-972f-bd4eb36ac410" containerName="pull"
Jul 10 21:25:48.139076 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.138966    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5797620e-c049-45a9-972f-bd4eb36ac410" containerName="pull"
Jul 10 21:25:48.139076 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.139012    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5797620e-c049-45a9-972f-bd4eb36ac410" containerName="extract"
Jul 10 21:25:48.142896 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.142873    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.146452 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.146434    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 21:25:48.146571 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.146486    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 21:25:48.147470 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.147451    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8jfkq\""
Jul 10 21:25:48.147470 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.147466    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 21:25:48.147613 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.147542    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 21:25:48.159735 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.159713    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"]
Jul 10 21:25:48.221415 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.221378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqnnc\" (UniqueName: \"kubernetes.io/projected/798507c2-89b0-40dd-bbb8-3d46af28c081-kube-api-access-qqnnc\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.221591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.221440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/798507c2-89b0-40dd-bbb8-3d46af28c081-tmp\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.221591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.221458    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/798507c2-89b0-40dd-bbb8-3d46af28c081-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.221591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.221477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/798507c2-89b0-40dd-bbb8-3d46af28c081-manifests\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.221591 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.221494    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/798507c2-89b0-40dd-bbb8-3d46af28c081-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.306023 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.305905    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:48.322366 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.322332    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/798507c2-89b0-40dd-bbb8-3d46af28c081-tmp\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.322366 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.322369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/798507c2-89b0-40dd-bbb8-3d46af28c081-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.322612 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.322387    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/798507c2-89b0-40dd-bbb8-3d46af28c081-manifests\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.322612 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.322407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/798507c2-89b0-40dd-bbb8-3d46af28c081-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.322612 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.322491    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqnnc\" (UniqueName: \"kubernetes.io/projected/798507c2-89b0-40dd-bbb8-3d46af28c081-kube-api-access-qqnnc\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.323088 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.323053    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/798507c2-89b0-40dd-bbb8-3d46af28c081-manifests\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.325178 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.325132    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/798507c2-89b0-40dd-bbb8-3d46af28c081-tmp\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.325525 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.325504    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/798507c2-89b0-40dd-bbb8-3d46af28c081-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.325752 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.325735    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/798507c2-89b0-40dd-bbb8-3d46af28c081-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.334412 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.334385    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqnnc\" (UniqueName: \"kubernetes.io/projected/798507c2-89b0-40dd-bbb8-3d46af28c081-kube-api-access-qqnnc\") pod \"opendatahub-operator-controller-manager-6d8977cb58-27p7s\" (UID: \"798507c2-89b0-40dd-bbb8-3d46af28c081\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.436472 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.436439    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:48.452397 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.452371    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:48.537156 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.537123    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:48.612839 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.612815    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"]
Jul 10 21:25:48.614496 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:25:48.614470    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798507c2_89b0_40dd_bbb8_3d46af28c081.slice/crio-6d7201d10f082cb7fad3f902d16c17f30a92423acd2d68c8b9a245827303496b WatchSource:0}: Error finding container 6d7201d10f082cb7fad3f902d16c17f30a92423acd2d68c8b9a245827303496b: Status 404 returned error can't find the container with id 6d7201d10f082cb7fad3f902d16c17f30a92423acd2d68c8b9a245827303496b
Jul 10 21:25:48.667923 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.667893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s" event={"ID":"798507c2-89b0-40dd-bbb8-3d46af28c081","Type":"ContainerStarted","Data":"6d7201d10f082cb7fad3f902d16c17f30a92423acd2d68c8b9a245827303496b"}
Jul 10 21:25:48.687672 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.687639    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:48.873187 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.873109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:48.988707 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:48.988668    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:25:52.688207 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:52.688170    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s" event={"ID":"798507c2-89b0-40dd-bbb8-3d46af28c081","Type":"ContainerStarted","Data":"25380ba2c4cbf67fc7f6982190222727ebe2c5dddddf0162f054ec25977822d1"}
Jul 10 21:25:53.693717 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:53.693682    2575 generic.go:356] "Generic (PLEG): container finished" podID="798507c2-89b0-40dd-bbb8-3d46af28c081" containerID="25380ba2c4cbf67fc7f6982190222727ebe2c5dddddf0162f054ec25977822d1" exitCode=0
Jul 10 21:25:53.694107 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:53.693755    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s" event={"ID":"798507c2-89b0-40dd-bbb8-3d46af28c081","Type":"ContainerDied","Data":"25380ba2c4cbf67fc7f6982190222727ebe2c5dddddf0162f054ec25977822d1"}
Jul 10 21:25:54.699876 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:54.699845    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s" event={"ID":"798507c2-89b0-40dd-bbb8-3d46af28c081","Type":"ContainerStarted","Data":"71852cedacd1a0f749210df93cc860c90c1f8ee32e73362b7fd9196f6c75da20"}
Jul 10 21:25:54.700234 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:54.699977    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:25:54.725042 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:54.724978    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s" podStartSLOduration=1.9893676340000002 podStartE2EDuration="6.724957213s" totalImagesPullingTime="3.657330055s" totalInitContainerRuntime="1.078259524s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:25:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:25:54.724503832 +0000 UTC m=+280.357749086" watchObservedRunningTime="2026-07-10 21:25:54.724957213 +0000 UTC m=+280.358202468"
Jul 10 21:25:59.325357 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:25:59.325325    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:00.733029 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:00.732981    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:04.351868 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:04.351824    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:04.452358 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:04.452320    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:05.706445 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:05.706413    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-27p7s"
Jul 10 21:26:09.025536 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.025507    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:09.214741 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.214703    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:09.501170 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.501138    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:09.659261 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.659231    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"]
Jul 10 21:26:09.662358 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.662338    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"
Jul 10 21:26:09.664895 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.664864    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 21:26:09.666092 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.666062    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 21:26:09.666986 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.666959    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 21:26:09.667248 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.667230    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 21:26:09.668922 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.668903    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2hwlg\""
Jul 10 21:26:09.679020 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.678996    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"]
Jul 10 21:26:09.766537 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.766448    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:09.789797 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.789766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr9z7\" (UniqueName: \"kubernetes.io/projected/d833e77e-d8e1-48f6-b76c-9afcb13af7c4-kube-api-access-sr9z7\") pod \"kube-auth-proxy-7c7cf6c8b8-lrmch\" (UID: \"d833e77e-d8e1-48f6-b76c-9afcb13af7c4\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"
Jul 10 21:26:09.789948 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.789800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d833e77e-d8e1-48f6-b76c-9afcb13af7c4-tmp\") pod \"kube-auth-proxy-7c7cf6c8b8-lrmch\" (UID: \"d833e77e-d8e1-48f6-b76c-9afcb13af7c4\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"
Jul 10 21:26:09.789948 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.789825    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d833e77e-d8e1-48f6-b76c-9afcb13af7c4-tls-certs\") pod \"kube-auth-proxy-7c7cf6c8b8-lrmch\" (UID: \"d833e77e-d8e1-48f6-b76c-9afcb13af7c4\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"
Jul 10 21:26:09.890941 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.890907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d833e77e-d8e1-48f6-b76c-9afcb13af7c4-tls-certs\") pod \"kube-auth-proxy-7c7cf6c8b8-lrmch\" (UID: \"d833e77e-d8e1-48f6-b76c-9afcb13af7c4\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"
Jul 10 21:26:09.891096 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.890968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr9z7\" (UniqueName: \"kubernetes.io/projected/d833e77e-d8e1-48f6-b76c-9afcb13af7c4-kube-api-access-sr9z7\") pod \"kube-auth-proxy-7c7cf6c8b8-lrmch\" (UID: \"d833e77e-d8e1-48f6-b76c-9afcb13af7c4\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"
Jul 10 21:26:09.891096 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.891074    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d833e77e-d8e1-48f6-b76c-9afcb13af7c4-tmp\") pod \"kube-auth-proxy-7c7cf6c8b8-lrmch\" (UID: \"d833e77e-d8e1-48f6-b76c-9afcb13af7c4\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"
Jul 10 21:26:09.893366 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.893334    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d833e77e-d8e1-48f6-b76c-9afcb13af7c4-tmp\") pod \"kube-auth-proxy-7c7cf6c8b8-lrmch\" (UID: \"d833e77e-d8e1-48f6-b76c-9afcb13af7c4\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"
Jul 10 21:26:09.893592 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.893571    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d833e77e-d8e1-48f6-b76c-9afcb13af7c4-tls-certs\") pod \"kube-auth-proxy-7c7cf6c8b8-lrmch\" (UID: \"d833e77e-d8e1-48f6-b76c-9afcb13af7c4\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"
Jul 10 21:26:09.915477 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.915448    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr9z7\" (UniqueName: \"kubernetes.io/projected/d833e77e-d8e1-48f6-b76c-9afcb13af7c4-kube-api-access-sr9z7\") pod \"kube-auth-proxy-7c7cf6c8b8-lrmch\" (UID: \"d833e77e-d8e1-48f6-b76c-9afcb13af7c4\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"
Jul 10 21:26:09.974183 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:09.974143    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"
Jul 10 21:26:10.127327 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.127294    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch"]
Jul 10 21:26:10.130920 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:26:10.130884    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd833e77e_d8e1_48f6_b76c_9afcb13af7c4.slice/crio-853ad9f38707f982fa542f0409ee3f95001afb294e2f887ad9d69127e7c2b32b WatchSource:0}: Error finding container 853ad9f38707f982fa542f0409ee3f95001afb294e2f887ad9d69127e7c2b32b: Status 404 returned error can't find the container with id 853ad9f38707f982fa542f0409ee3f95001afb294e2f887ad9d69127e7c2b32b
Jul 10 21:26:10.150562 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.150526    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-k4qks"]
Jul 10 21:26:10.155112 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.155090    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-k4qks"
Jul 10 21:26:10.159457 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.159434    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ng7vp\""
Jul 10 21:26:10.159788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.159766    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 10 21:26:10.175425 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.175393    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-k4qks"]
Jul 10 21:26:10.238620 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.238590    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:10.294771 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.294681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-657lb\" (UniqueName: \"kubernetes.io/projected/dcc50043-beb8-4be5-99c4-50f53ca29eba-kube-api-access-657lb\") pod \"odh-model-controller-7998c67dc4-k4qks\" (UID: \"dcc50043-beb8-4be5-99c4-50f53ca29eba\") " pod="opendatahub/odh-model-controller-7998c67dc4-k4qks"
Jul 10 21:26:10.294771 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.294741    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcc50043-beb8-4be5-99c4-50f53ca29eba-cert\") pod \"odh-model-controller-7998c67dc4-k4qks\" (UID: \"dcc50043-beb8-4be5-99c4-50f53ca29eba\") " pod="opendatahub/odh-model-controller-7998c67dc4-k4qks"
Jul 10 21:26:10.338174 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.338136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:10.396142 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.396108    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcc50043-beb8-4be5-99c4-50f53ca29eba-cert\") pod \"odh-model-controller-7998c67dc4-k4qks\" (UID: \"dcc50043-beb8-4be5-99c4-50f53ca29eba\") " pod="opendatahub/odh-model-controller-7998c67dc4-k4qks"
Jul 10 21:26:10.396352 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.396171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-657lb\" (UniqueName: \"kubernetes.io/projected/dcc50043-beb8-4be5-99c4-50f53ca29eba-kube-api-access-657lb\") pod \"odh-model-controller-7998c67dc4-k4qks\" (UID: \"dcc50043-beb8-4be5-99c4-50f53ca29eba\") " pod="opendatahub/odh-model-controller-7998c67dc4-k4qks"
Jul 10 21:26:10.396352 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:26:10.396296    2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 10 21:26:10.396476 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:26:10.396370    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc50043-beb8-4be5-99c4-50f53ca29eba-cert podName:dcc50043-beb8-4be5-99c4-50f53ca29eba nodeName:}" failed. No retries permitted until 2026-07-10 21:26:10.896347149 +0000 UTC m=+296.529592380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dcc50043-beb8-4be5-99c4-50f53ca29eba-cert") pod "odh-model-controller-7998c67dc4-k4qks" (UID: "dcc50043-beb8-4be5-99c4-50f53ca29eba") : secret "odh-model-controller-webhook-cert" not found
Jul 10 21:26:10.414331 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.414300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-657lb\" (UniqueName: \"kubernetes.io/projected/dcc50043-beb8-4be5-99c4-50f53ca29eba-kube-api-access-657lb\") pod \"odh-model-controller-7998c67dc4-k4qks\" (UID: \"dcc50043-beb8-4be5-99c4-50f53ca29eba\") " pod="opendatahub/odh-model-controller-7998c67dc4-k4qks"
Jul 10 21:26:10.443454 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.443422    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:10.764107 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.764059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:10.768573 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.768549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch" event={"ID":"d833e77e-d8e1-48f6-b76c-9afcb13af7c4","Type":"ContainerStarted","Data":"853ad9f38707f982fa542f0409ee3f95001afb294e2f887ad9d69127e7c2b32b"}
Jul 10 21:26:10.901659 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.901557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcc50043-beb8-4be5-99c4-50f53ca29eba-cert\") pod \"odh-model-controller-7998c67dc4-k4qks\" (UID: \"dcc50043-beb8-4be5-99c4-50f53ca29eba\") " pod="opendatahub/odh-model-controller-7998c67dc4-k4qks"
Jul 10 21:26:10.904257 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:10.904227    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcc50043-beb8-4be5-99c4-50f53ca29eba-cert\") pod \"odh-model-controller-7998c67dc4-k4qks\" (UID: \"dcc50043-beb8-4be5-99c4-50f53ca29eba\") " pod="opendatahub/odh-model-controller-7998c67dc4-k4qks"
Jul 10 21:26:11.065940 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.065854    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-k4qks"
Jul 10 21:26:11.264056 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.264026    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-k4qks"]
Jul 10 21:26:11.267568 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:26:11.267537    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc50043_beb8_4be5_99c4_50f53ca29eba.slice/crio-c490dd706efa3c3294e953b7112ef0f364dba349c2c67637a2b5537953189d40 WatchSource:0}: Error finding container c490dd706efa3c3294e953b7112ef0f364dba349c2c67637a2b5537953189d40: Status 404 returned error can't find the container with id c490dd706efa3c3294e953b7112ef0f364dba349c2c67637a2b5537953189d40
Jul 10 21:26:11.300327 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.300291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:11.354669 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.354632    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bq4g2"]
Jul 10 21:26:11.359196 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.359175    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2"
Jul 10 21:26:11.363324 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.363302    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 10 21:26:11.363444 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.363302    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-9lfw2\""
Jul 10 21:26:11.374173 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.374147    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bq4g2"]
Jul 10 21:26:11.405742 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.405693    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:11.506460 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.506430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2357ad-56e8-4deb-8265-989bfe7912a1-tls-certs\") pod \"model-serving-api-54d89bd5fc-bq4g2\" (UID: \"ac2357ad-56e8-4deb-8265-989bfe7912a1\") " pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2"
Jul 10 21:26:11.506635 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.506514    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbj7p\" (UniqueName: \"kubernetes.io/projected/ac2357ad-56e8-4deb-8265-989bfe7912a1-kube-api-access-xbj7p\") pod \"model-serving-api-54d89bd5fc-bq4g2\" (UID: \"ac2357ad-56e8-4deb-8265-989bfe7912a1\") " pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2"
Jul 10 21:26:11.538993 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.538954    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:11.551431 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.551398    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"]
Jul 10 21:26:11.554989 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.554965    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.558809 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.558779    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 21:26:11.558943 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.558820    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 10 21:26:11.558943 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.558859    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 10 21:26:11.558943 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.558787    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 10 21:26:11.559101 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.559067    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kl5kn\""
Jul 10 21:26:11.569018 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.568979    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"]
Jul 10 21:26:11.607480 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.607403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2357ad-56e8-4deb-8265-989bfe7912a1-tls-certs\") pod \"model-serving-api-54d89bd5fc-bq4g2\" (UID: \"ac2357ad-56e8-4deb-8265-989bfe7912a1\") " pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2"
Jul 10 21:26:11.607639 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.607498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbj7p\" (UniqueName: \"kubernetes.io/projected/ac2357ad-56e8-4deb-8265-989bfe7912a1-kube-api-access-xbj7p\") pod \"model-serving-api-54d89bd5fc-bq4g2\" (UID: \"ac2357ad-56e8-4deb-8265-989bfe7912a1\") " pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2"
Jul 10 21:26:11.610092 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.610070    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2357ad-56e8-4deb-8265-989bfe7912a1-tls-certs\") pod \"model-serving-api-54d89bd5fc-bq4g2\" (UID: \"ac2357ad-56e8-4deb-8265-989bfe7912a1\") " pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2"
Jul 10 21:26:11.614887 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.614852    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:11.616607 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.616587    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbj7p\" (UniqueName: \"kubernetes.io/projected/ac2357ad-56e8-4deb-8265-989bfe7912a1-kube-api-access-xbj7p\") pod \"model-serving-api-54d89bd5fc-bq4g2\" (UID: \"ac2357ad-56e8-4deb-8265-989bfe7912a1\") " pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2"
Jul 10 21:26:11.672251 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.672216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2"
Jul 10 21:26:11.708464 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.708432    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-cacerts\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.708464 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.708468    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.708713 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.708493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.708713 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.708524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-token\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.708713 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.708585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z58jr\" (UniqueName: \"kubernetes.io/projected/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-kube-api-access-z58jr\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.708713 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.708632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-local-certs\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.708713 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.708682    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.777128 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.777090    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-k4qks" event={"ID":"dcc50043-beb8-4be5-99c4-50f53ca29eba","Type":"ContainerStarted","Data":"c490dd706efa3c3294e953b7112ef0f364dba349c2c67637a2b5537953189d40"}
Jul 10 21:26:11.810007 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.809976    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z58jr\" (UniqueName: \"kubernetes.io/projected/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-kube-api-access-z58jr\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.810177 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.810021    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-local-certs\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.810177 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.810068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.810177 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.810095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-cacerts\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.810177 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.810118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.810177 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.810144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.810177 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.810173    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-token\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.810909 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.810882    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.812582 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.812559    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.812690 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.812561    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-local-certs\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.812690 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.812609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.812937 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.812920    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-cacerts\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.820640 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.820610    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bq4g2"]
Jul 10 21:26:11.822693 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.822653    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-token\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.822693 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.822659    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z58jr\" (UniqueName: \"kubernetes.io/projected/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-kube-api-access-z58jr\") pod \"istiod-openshift-gateway-7574459656-h74t5\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:11.822945 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:26:11.822921    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac2357ad_56e8_4deb_8265_989bfe7912a1.slice/crio-09b3a6267fb645539675d2ff6b793659c1920c97281bccceccaee611f84f22ac WatchSource:0}: Error finding container 09b3a6267fb645539675d2ff6b793659c1920c97281bccceccaee611f84f22ac: Status 404 returned error can't find the container with id 09b3a6267fb645539675d2ff6b793659c1920c97281bccceccaee611f84f22ac
Jul 10 21:26:11.867575 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:11.867493    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:12.038158 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:12.038052    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"]
Jul 10 21:26:12.041254 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:26:12.041221    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6dfcbc2_8b15_498a_9e67_ca8a9dc22894.slice/crio-2ce160624e9920e210d9054435d70d878acc1eee1bf144714f9fdf0e656b9064 WatchSource:0}: Error finding container 2ce160624e9920e210d9054435d70d878acc1eee1bf144714f9fdf0e656b9064: Status 404 returned error can't find the container with id 2ce160624e9920e210d9054435d70d878acc1eee1bf144714f9fdf0e656b9064
Jul 10 21:26:12.738062 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:12.737993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:12.793616 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:12.792778    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5" event={"ID":"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894","Type":"ContainerStarted","Data":"2ce160624e9920e210d9054435d70d878acc1eee1bf144714f9fdf0e656b9064"}
Jul 10 21:26:12.797336 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:12.797264    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2" event={"ID":"ac2357ad-56e8-4deb-8265-989bfe7912a1","Type":"ContainerStarted","Data":"09b3a6267fb645539675d2ff6b793659c1920c97281bccceccaee611f84f22ac"}
Jul 10 21:26:15.406449 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:15.406324    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:26:15.410150 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:15.410042    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:26:15.412995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:15.412974    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 21:26:15.815154 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:15.815116    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-k4qks" event={"ID":"dcc50043-beb8-4be5-99c4-50f53ca29eba","Type":"ContainerStarted","Data":"1e8f65c122b6a691c1ed1e5127a89065310fa1f073fc40375e30459ef8fa7d24"}
Jul 10 21:26:15.817136 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:15.815221    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-k4qks"
Jul 10 21:26:15.817136 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:15.816865    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch" event={"ID":"d833e77e-d8e1-48f6-b76c-9afcb13af7c4","Type":"ContainerStarted","Data":"1a5434fadecd31c722e807d1648f66cf44929042fe8771f4ca8959ca1a0487d5"}
Jul 10 21:26:15.818376 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:15.818352    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2" event={"ID":"ac2357ad-56e8-4deb-8265-989bfe7912a1","Type":"ContainerStarted","Data":"78a5a0573de48a7576d13dc81f66c97e68bfa01730e7ce1c27b6a8a438ddd0c6"}
Jul 10 21:26:15.818499 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:15.818485    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2"
Jul 10 21:26:15.834627 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:15.833491    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-k4qks" podStartSLOduration=1.817934208 podStartE2EDuration="5.833472379s" totalImagesPullingTime="4.015538171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:26:15.832479064 +0000 UTC m=+301.465724316" watchObservedRunningTime="2026-07-10 21:26:15.833472379 +0000 UTC m=+301.466717634"
Jul 10 21:26:15.855705 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:15.855636    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-lrmch" podStartSLOduration=1.7031917829999998 podStartE2EDuration="6.855615481s" totalImagesPullingTime="5.152423698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:26:15.853587565 +0000 UTC m=+301.486832857" watchObservedRunningTime="2026-07-10 21:26:15.855615481 +0000 UTC m=+301.488860737"
Jul 10 21:26:15.874007 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:15.873936    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2" podStartSLOduration=1.409663898 podStartE2EDuration="4.873915603s" totalImagesPullingTime="3.464251705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:26:15.873311417 +0000 UTC m=+301.506556671" watchObservedRunningTime="2026-07-10 21:26:15.873915603 +0000 UTC m=+301.507160855"
Jul 10 21:26:17.013135 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:17.013093    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:26:17.013560 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:17.013180    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:26:17.781504 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:17.781463    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:17.830320 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:17.830257    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5" event={"ID":"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894","Type":"ContainerStarted","Data":"74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6"}
Jul 10 21:26:17.830515 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:17.830357    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:17.853172 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:17.853115    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5" podStartSLOduration=1.884741856 podStartE2EDuration="6.85309687s" totalImagesPullingTime="4.968355014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:26:17.852284999 +0000 UTC m=+303.485530246" watchObservedRunningTime="2026-07-10 21:26:17.85309687 +0000 UTC m=+303.486342123"
Jul 10 21:26:17.862560 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:17.862526    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:18.033933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:18.033854    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:18.215697 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:18.215660    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:18.513321 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:18.513266    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:18.835959 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:18.835934    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:21.932478 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:21.932440    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:22.041025 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.040989    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"]
Jul 10 21:26:22.044470 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.044451    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"
Jul 10 21:26:22.047665 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.047641    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 10 21:26:22.047881 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.047860    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4bskk\""
Jul 10 21:26:22.056984 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.056954    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:22.061417 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.061391    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"]
Jul 10 21:26:22.072883 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.072855    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"]
Jul 10 21:26:22.076456 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.076434    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"
Jul 10 21:26:22.079375 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.079352    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 10 21:26:22.079502 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.079440    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jgjpk\""
Jul 10 21:26:22.087216 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.087194    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16113ca9-4fa3-40df-9eff-1da6482d5c93-cert\") pod \"kserve-controller-manager-d6f4b65b8-w7zkz\" (UID: \"16113ca9-4fa3-40df-9eff-1da6482d5c93\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"
Jul 10 21:26:22.088115 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.088090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z9ns\" (UniqueName: \"kubernetes.io/projected/16113ca9-4fa3-40df-9eff-1da6482d5c93-kube-api-access-6z9ns\") pod \"kserve-controller-manager-d6f4b65b8-w7zkz\" (UID: \"16113ca9-4fa3-40df-9eff-1da6482d5c93\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"
Jul 10 21:26:22.088341 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.088326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fcf9535-e6cf-4af3-9b20-37334aff41c4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-97nwr\" (UID: \"9fcf9535-e6cf-4af3-9b20-37334aff41c4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"
Jul 10 21:26:22.088504 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.088489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmc9p\" (UniqueName: \"kubernetes.io/projected/9fcf9535-e6cf-4af3-9b20-37334aff41c4-kube-api-access-hmc9p\") pod \"llmisvc-controller-manager-777c6bd7d5-97nwr\" (UID: \"9fcf9535-e6cf-4af3-9b20-37334aff41c4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"
Jul 10 21:26:22.091363 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.091339    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"]
Jul 10 21:26:22.190170 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.190083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16113ca9-4fa3-40df-9eff-1da6482d5c93-cert\") pod \"kserve-controller-manager-d6f4b65b8-w7zkz\" (UID: \"16113ca9-4fa3-40df-9eff-1da6482d5c93\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"
Jul 10 21:26:22.190170 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.190122    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9ns\" (UniqueName: \"kubernetes.io/projected/16113ca9-4fa3-40df-9eff-1da6482d5c93-kube-api-access-6z9ns\") pod \"kserve-controller-manager-d6f4b65b8-w7zkz\" (UID: \"16113ca9-4fa3-40df-9eff-1da6482d5c93\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"
Jul 10 21:26:22.190454 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.190179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fcf9535-e6cf-4af3-9b20-37334aff41c4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-97nwr\" (UID: \"9fcf9535-e6cf-4af3-9b20-37334aff41c4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"
Jul 10 21:26:22.190454 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.190210    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmc9p\" (UniqueName: \"kubernetes.io/projected/9fcf9535-e6cf-4af3-9b20-37334aff41c4-kube-api-access-hmc9p\") pod \"llmisvc-controller-manager-777c6bd7d5-97nwr\" (UID: \"9fcf9535-e6cf-4af3-9b20-37334aff41c4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"
Jul 10 21:26:22.192664 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.192643    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16113ca9-4fa3-40df-9eff-1da6482d5c93-cert\") pod \"kserve-controller-manager-d6f4b65b8-w7zkz\" (UID: \"16113ca9-4fa3-40df-9eff-1da6482d5c93\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"
Jul 10 21:26:22.192876 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.192855    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fcf9535-e6cf-4af3-9b20-37334aff41c4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-97nwr\" (UID: \"9fcf9535-e6cf-4af3-9b20-37334aff41c4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"
Jul 10 21:26:22.197912 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.197891    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:22.206067 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.206041    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmc9p\" (UniqueName: \"kubernetes.io/projected/9fcf9535-e6cf-4af3-9b20-37334aff41c4-kube-api-access-hmc9p\") pod \"llmisvc-controller-manager-777c6bd7d5-97nwr\" (UID: \"9fcf9535-e6cf-4af3-9b20-37334aff41c4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"
Jul 10 21:26:22.206240 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.206221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z9ns\" (UniqueName: \"kubernetes.io/projected/16113ca9-4fa3-40df-9eff-1da6482d5c93-kube-api-access-6z9ns\") pod \"kserve-controller-manager-d6f4b65b8-w7zkz\" (UID: \"16113ca9-4fa3-40df-9eff-1da6482d5c93\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"
Jul 10 21:26:22.336994 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.336963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:22.357000 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.356971    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"
Jul 10 21:26:22.391035 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.390994    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"
Jul 10 21:26:22.544989 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.544967    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"]
Jul 10 21:26:22.547200 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:26:22.547172    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16113ca9_4fa3_40df_9eff_1da6482d5c93.slice/crio-78077e610640f01ee0b531b76bdca4ba19053d5f507fc29e6eb255ee31d43274 WatchSource:0}: Error finding container 78077e610640f01ee0b531b76bdca4ba19053d5f507fc29e6eb255ee31d43274: Status 404 returned error can't find the container with id 78077e610640f01ee0b531b76bdca4ba19053d5f507fc29e6eb255ee31d43274
Jul 10 21:26:22.548456 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.548437    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 21:26:22.559877 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.559856    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"]
Jul 10 21:26:22.560985 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:26:22.560964    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9fcf9535_e6cf_4af3_9b20_37334aff41c4.slice/crio-a1888dfe76a792142a0cd2481860173775098a6c6f04f134f6ea00c52105a7b6 WatchSource:0}: Error finding container a1888dfe76a792142a0cd2481860173775098a6c6f04f134f6ea00c52105a7b6: Status 404 returned error can't find the container with id a1888dfe76a792142a0cd2481860173775098a6c6f04f134f6ea00c52105a7b6
Jul 10 21:26:22.851952 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.851921    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr" event={"ID":"9fcf9535-e6cf-4af3-9b20-37334aff41c4","Type":"ContainerStarted","Data":"a1888dfe76a792142a0cd2481860173775098a6c6f04f134f6ea00c52105a7b6"}
Jul 10 21:26:22.852861 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:22.852840    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz" event={"ID":"16113ca9-4fa3-40df-9eff-1da6482d5c93","Type":"ContainerStarted","Data":"78077e610640f01ee0b531b76bdca4ba19053d5f507fc29e6eb255ee31d43274"}
Jul 10 21:26:23.293552 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:23.293471    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:23.390827 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:23.390793    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:23.831310 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:23.831095    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"]
Jul 10 21:26:23.831558 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:23.831307    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5" podUID="a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" containerName="discovery" containerID="cri-o://74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6" gracePeriod=30
Jul 10 21:26:24.365267 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.365187    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:24.410073 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.410037    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-cacerts\") pod \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") "
Jul 10 21:26:24.410073 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.410086    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-csr-dns-cert\") pod \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") "
Jul 10 21:26:24.410336 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.410132    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-csr-ca-configmap\") pod \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") "
Jul 10 21:26:24.410336 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.410163    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-token\") pod \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") "
Jul 10 21:26:24.410336 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.410251    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z58jr\" (UniqueName: \"kubernetes.io/projected/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-kube-api-access-z58jr\") pod \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") "
Jul 10 21:26:24.410336 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.410296    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-local-certs\") pod \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") "
Jul 10 21:26:24.410336 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.410326    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-kubeconfig\") pod \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\" (UID: \"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894\") "
Jul 10 21:26:24.411627 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.411586    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" (UID: "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:26:24.412839 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.412804    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-cacerts" (OuterVolumeSpecName: "cacerts") pod "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" (UID: "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:26:24.412839 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.412823    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" (UID: "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:26:24.413322 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.413254    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" (UID: "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:26:24.414080 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.414054    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" (UID: "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:26:24.414532 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.414506    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-kube-api-access-z58jr" (OuterVolumeSpecName: "kube-api-access-z58jr") pod "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" (UID: "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894"). InnerVolumeSpecName "kube-api-access-z58jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:26:24.415207 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.415173    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-local-certs" (OuterVolumeSpecName: "local-certs") pod "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" (UID: "a6dfcbc2-8b15-498a-9e67-ca8a9dc22894"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:26:24.511901 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.511871    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z58jr\" (UniqueName: \"kubernetes.io/projected/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-kube-api-access-z58jr\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:26:24.511901 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.511899    2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-local-certs\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:26:24.511901 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.511908    2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-kubeconfig\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:26:24.512159 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.511919    2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-cacerts\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:26:24.512159 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.511933    2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-csr-dns-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:26:24.512159 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.511945    2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-csr-ca-configmap\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:26:24.512159 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.511959    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894-istio-token\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:26:24.866626 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.866589    2575 generic.go:356] "Generic (PLEG): container finished" podID="a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" containerID="74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6" exitCode=0
Jul 10 21:26:24.866784 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.866687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5" event={"ID":"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894","Type":"ContainerDied","Data":"74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6"}
Jul 10 21:26:24.866784 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.866724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5" event={"ID":"a6dfcbc2-8b15-498a-9e67-ca8a9dc22894","Type":"ContainerDied","Data":"2ce160624e9920e210d9054435d70d878acc1eee1bf144714f9fdf0e656b9064"}
Jul 10 21:26:24.866784 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.866752    2575 scope.go:117] "RemoveContainer" containerID="74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6"
Jul 10 21:26:24.866973 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.866906    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"
Jul 10 21:26:24.903258 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.903222    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"]
Jul 10 21:26:24.906904 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:24.906874    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h74t5"]
Jul 10 21:26:25.031512 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:25.031488    2575 scope.go:117] "RemoveContainer" containerID="74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6"
Jul 10 21:26:25.031904 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:26:25.031879    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6\": container with ID starting with 74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6 not found: ID does not exist" containerID="74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6"
Jul 10 21:26:25.031993 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:25.031914    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6"} err="failed to get container status \"74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6\": rpc error: code = NotFound desc = could not find container \"74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6\": container with ID starting with 74c0a128fe041f63826a245bb99c6c8870f286eeff6c7b6b4852dc72fa3e73e6 not found: ID does not exist"
Jul 10 21:26:25.523751 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:25.523668    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" path="/var/lib/kubelet/pods/a6dfcbc2-8b15-498a-9e67-ca8a9dc22894/volumes"
Jul 10 21:26:25.875113 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:25.875066    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz" event={"ID":"16113ca9-4fa3-40df-9eff-1da6482d5c93","Type":"ContainerStarted","Data":"b962039cbc4ff2b4a7ba7c4f86598a18f143ced9e983844e2de9f4905092df6d"}
Jul 10 21:26:25.875339 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:25.875190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"
Jul 10 21:26:25.917473 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:25.917406    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz" podStartSLOduration=1.303613192 podStartE2EDuration="3.917384081s" totalImagesPullingTime="2.613770889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:26:25.913839344 +0000 UTC m=+311.547084597" watchObservedRunningTime="2026-07-10 21:26:25.917384081 +0000 UTC m=+311.550629337"
Jul 10 21:26:26.826249 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:26.826214    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-k4qks"
Jul 10 21:26:26.828247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:26.828227    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-bq4g2"
Jul 10 21:26:26.882886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:26.882844    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr" event={"ID":"9fcf9535-e6cf-4af3-9b20-37334aff41c4","Type":"ContainerStarted","Data":"657ff020abf76e24e90c62ce5ca822b0364525978b12a7eacaeb0f16f50670ab"}
Jul 10 21:26:26.900363 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:26.900313    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr" podStartSLOduration=1.442171625 podStartE2EDuration="4.900297407s" totalImagesPullingTime="3.458125782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:26:26.899122795 +0000 UTC m=+312.532368049" watchObservedRunningTime="2026-07-10 21:26:26.900297407 +0000 UTC m=+312.533542659"
Jul 10 21:26:27.887588 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:27.887551    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"
Jul 10 21:26:29.964106 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:29.964075    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:30.060750 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:30.060717    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:46.217033 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:46.217003    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:26:56.888230 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:56.888199    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w7zkz"
Jul 10 21:26:58.894578 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:26:58.894549    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-97nwr"
Jul 10 21:27:10.590526 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.590444    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:10.691578 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.691552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:10.732789 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.732752    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wp25q"]
Jul 10 21:27:10.733048 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.733037    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" containerName="discovery"
Jul 10 21:27:10.733089 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.733049    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" containerName="discovery"
Jul 10 21:27:10.733126 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.733094    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6dfcbc2-8b15-498a-9e67-ca8a9dc22894" containerName="discovery"
Jul 10 21:27:10.734793 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.734776    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wp25q"
Jul 10 21:27:10.737923 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.737880    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 21:27:10.738716 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.738695    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-q86pq\""
Jul 10 21:27:10.738836 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.738793    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 21:27:10.748773 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.748746    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wp25q"]
Jul 10 21:27:10.793627 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.793589    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:10.874792 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.874708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84f4m\" (UniqueName: \"kubernetes.io/projected/7488a9a6-50b7-4ec7-969f-143c1528b3e7-kube-api-access-84f4m\") pod \"kuadrant-operator-catalog-wp25q\" (UID: \"7488a9a6-50b7-4ec7-969f-143c1528b3e7\") " pod="kuadrant-system/kuadrant-operator-catalog-wp25q"
Jul 10 21:27:10.975335 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.975300    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84f4m\" (UniqueName: \"kubernetes.io/projected/7488a9a6-50b7-4ec7-969f-143c1528b3e7-kube-api-access-84f4m\") pod \"kuadrant-operator-catalog-wp25q\" (UID: \"7488a9a6-50b7-4ec7-969f-143c1528b3e7\") " pod="kuadrant-system/kuadrant-operator-catalog-wp25q"
Jul 10 21:27:10.984018 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:10.983988    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84f4m\" (UniqueName: \"kubernetes.io/projected/7488a9a6-50b7-4ec7-969f-143c1528b3e7-kube-api-access-84f4m\") pod \"kuadrant-operator-catalog-wp25q\" (UID: \"7488a9a6-50b7-4ec7-969f-143c1528b3e7\") " pod="kuadrant-system/kuadrant-operator-catalog-wp25q"
Jul 10 21:27:11.045259 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.045222    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wp25q"
Jul 10 21:27:11.097697 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.097662    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wp25q"]
Jul 10 21:27:11.176623 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.176601    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wp25q"]
Jul 10 21:27:11.179171 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:27:11.179144    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7488a9a6_50b7_4ec7_969f_143c1528b3e7.slice/crio-08d5d09864df432404492c589e63c6472b5f3103108a27232ca81d1afd077c7a WatchSource:0}: Error finding container 08d5d09864df432404492c589e63c6472b5f3103108a27232ca81d1afd077c7a: Status 404 returned error can't find the container with id 08d5d09864df432404492c589e63c6472b5f3103108a27232ca81d1afd077c7a
Jul 10 21:27:11.308043 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.308006    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7t9wp"]
Jul 10 21:27:11.310671 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.310653    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7t9wp"
Jul 10 21:27:11.319848 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.319821    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7t9wp"]
Jul 10 21:27:11.378639 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.378554    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n6tw\" (UniqueName: \"kubernetes.io/projected/89b1aff5-f8bf-471f-a5b4-f9de786467de-kube-api-access-6n6tw\") pod \"kuadrant-operator-catalog-7t9wp\" (UID: \"89b1aff5-f8bf-471f-a5b4-f9de786467de\") " pod="kuadrant-system/kuadrant-operator-catalog-7t9wp"
Jul 10 21:27:11.479619 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.479586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n6tw\" (UniqueName: \"kubernetes.io/projected/89b1aff5-f8bf-471f-a5b4-f9de786467de-kube-api-access-6n6tw\") pod \"kuadrant-operator-catalog-7t9wp\" (UID: \"89b1aff5-f8bf-471f-a5b4-f9de786467de\") " pod="kuadrant-system/kuadrant-operator-catalog-7t9wp"
Jul 10 21:27:11.488933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.488910    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n6tw\" (UniqueName: \"kubernetes.io/projected/89b1aff5-f8bf-471f-a5b4-f9de786467de-kube-api-access-6n6tw\") pod \"kuadrant-operator-catalog-7t9wp\" (UID: \"89b1aff5-f8bf-471f-a5b4-f9de786467de\") " pod="kuadrant-system/kuadrant-operator-catalog-7t9wp"
Jul 10 21:27:11.548924 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.548888    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:11.621259 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.621215    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7t9wp"
Jul 10 21:27:11.740463 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.740428    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:11.750487 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:11.750464    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7t9wp"]
Jul 10 21:27:11.752528 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:27:11.752502    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89b1aff5_f8bf_471f_a5b4_f9de786467de.slice/crio-ece199c68ff766a7b9767a853a3b03464064fd66e698f6193d7a2f32f069b645 WatchSource:0}: Error finding container ece199c68ff766a7b9767a853a3b03464064fd66e698f6193d7a2f32f069b645: Status 404 returned error can't find the container with id ece199c68ff766a7b9767a853a3b03464064fd66e698f6193d7a2f32f069b645
Jul 10 21:27:12.083099 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:12.083070    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7t9wp" event={"ID":"89b1aff5-f8bf-471f-a5b4-f9de786467de","Type":"ContainerStarted","Data":"ece199c68ff766a7b9767a853a3b03464064fd66e698f6193d7a2f32f069b645"}
Jul 10 21:27:12.084312 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:12.084286    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wp25q" event={"ID":"7488a9a6-50b7-4ec7-969f-143c1528b3e7","Type":"ContainerStarted","Data":"08d5d09864df432404492c589e63c6472b5f3103108a27232ca81d1afd077c7a"}
Jul 10 21:27:14.097081 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:14.097044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7t9wp" event={"ID":"89b1aff5-f8bf-471f-a5b4-f9de786467de","Type":"ContainerStarted","Data":"46a17e358bc698e6671132e6236107f6f3dcfd3280fb4a3499f12d3448844013"}
Jul 10 21:27:14.098401 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:14.098379    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wp25q" event={"ID":"7488a9a6-50b7-4ec7-969f-143c1528b3e7","Type":"ContainerStarted","Data":"62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32"}
Jul 10 21:27:14.098502 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:14.098484    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wp25q" podUID="7488a9a6-50b7-4ec7-969f-143c1528b3e7" containerName="registry-server" containerID="cri-o://62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32" gracePeriod=2
Jul 10 21:27:14.114821 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:14.114777    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7t9wp" podStartSLOduration=1.7131564 podStartE2EDuration="3.11475997s" totalImagesPullingTime="1.40160357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:27:14.113562495 +0000 UTC m=+359.746807746" watchObservedRunningTime="2026-07-10 21:27:14.11475997 +0000 UTC m=+359.748005223"
Jul 10 21:27:14.134453 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:14.134399    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wp25q" podStartSLOduration=2.159901457 podStartE2EDuration="4.134381298s" totalImagesPullingTime="1.974479841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:27:14.128239583 +0000 UTC m=+359.761484872" watchObservedRunningTime="2026-07-10 21:27:14.134381298 +0000 UTC m=+359.767626551"
Jul 10 21:27:14.343165 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:14.343141    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wp25q"
Jul 10 21:27:14.504326 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:14.504209    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84f4m\" (UniqueName: \"kubernetes.io/projected/7488a9a6-50b7-4ec7-969f-143c1528b3e7-kube-api-access-84f4m\") pod \"7488a9a6-50b7-4ec7-969f-143c1528b3e7\" (UID: \"7488a9a6-50b7-4ec7-969f-143c1528b3e7\") "
Jul 10 21:27:14.506336 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:14.506310    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7488a9a6-50b7-4ec7-969f-143c1528b3e7-kube-api-access-84f4m" (OuterVolumeSpecName: "kube-api-access-84f4m") pod "7488a9a6-50b7-4ec7-969f-143c1528b3e7" (UID: "7488a9a6-50b7-4ec7-969f-143c1528b3e7"). InnerVolumeSpecName "kube-api-access-84f4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:27:14.605690 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:14.605651    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84f4m\" (UniqueName: \"kubernetes.io/projected/7488a9a6-50b7-4ec7-969f-143c1528b3e7-kube-api-access-84f4m\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:15.103465 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:15.103430    2575 generic.go:356] "Generic (PLEG): container finished" podID="7488a9a6-50b7-4ec7-969f-143c1528b3e7" containerID="62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32" exitCode=0
Jul 10 21:27:15.103933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:15.103475    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wp25q"
Jul 10 21:27:15.103933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:15.103507    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wp25q" event={"ID":"7488a9a6-50b7-4ec7-969f-143c1528b3e7","Type":"ContainerDied","Data":"62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32"}
Jul 10 21:27:15.103933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:15.103553    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wp25q" event={"ID":"7488a9a6-50b7-4ec7-969f-143c1528b3e7","Type":"ContainerDied","Data":"08d5d09864df432404492c589e63c6472b5f3103108a27232ca81d1afd077c7a"}
Jul 10 21:27:15.103933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:15.103581    2575 scope.go:117] "RemoveContainer" containerID="62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32"
Jul 10 21:27:15.112286 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:15.112257    2575 scope.go:117] "RemoveContainer" containerID="62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32"
Jul 10 21:27:15.112534 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:27:15.112513    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32\": container with ID starting with 62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32 not found: ID does not exist" containerID="62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32"
Jul 10 21:27:15.112577 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:15.112542    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32"} err="failed to get container status \"62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32\": rpc error: code = NotFound desc = could not find container \"62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32\": container with ID starting with 62b1a02520a7dea68adb49032ade5cd8bb45645f24c1de445a2dae1a330a0d32 not found: ID does not exist"
Jul 10 21:27:15.124010 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:15.123985    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wp25q"]
Jul 10 21:27:15.126290 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:15.126253    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wp25q"]
Jul 10 21:27:15.521915 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:15.521884    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7488a9a6-50b7-4ec7-969f-143c1528b3e7" path="/var/lib/kubelet/pods/7488a9a6-50b7-4ec7-969f-143c1528b3e7/volumes"
Jul 10 21:27:21.621634 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:21.621582    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7t9wp"
Jul 10 21:27:21.622153 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:21.621662    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7t9wp"
Jul 10 21:27:21.644251 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:21.644214    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7t9wp"
Jul 10 21:27:22.154601 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:22.154575    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7t9wp"
Jul 10 21:27:26.547493 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.547455    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"]
Jul 10 21:27:26.547885 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.547771    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7488a9a6-50b7-4ec7-969f-143c1528b3e7" containerName="registry-server"
Jul 10 21:27:26.547885 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.547781    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7488a9a6-50b7-4ec7-969f-143c1528b3e7" containerName="registry-server"
Jul 10 21:27:26.547885 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.547837    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7488a9a6-50b7-4ec7-969f-143c1528b3e7" containerName="registry-server"
Jul 10 21:27:26.552498 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.552481    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:26.554990 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.554966    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4k5w9\""
Jul 10 21:27:26.560936 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.560912    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"]
Jul 10 21:27:26.701732 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.701693    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5c2s\" (UniqueName: \"kubernetes.io/projected/4dc47687-277c-47d5-a256-2440265ac877-kube-api-access-g5c2s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr\" (UID: \"4dc47687-277c-47d5-a256-2440265ac877\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:26.701916 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.701775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dc47687-277c-47d5-a256-2440265ac877-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr\" (UID: \"4dc47687-277c-47d5-a256-2440265ac877\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:26.701916 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.701813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dc47687-277c-47d5-a256-2440265ac877-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr\" (UID: \"4dc47687-277c-47d5-a256-2440265ac877\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:26.802646 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.802563    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dc47687-277c-47d5-a256-2440265ac877-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr\" (UID: \"4dc47687-277c-47d5-a256-2440265ac877\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:26.802646 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.802610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5c2s\" (UniqueName: \"kubernetes.io/projected/4dc47687-277c-47d5-a256-2440265ac877-kube-api-access-g5c2s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr\" (UID: \"4dc47687-277c-47d5-a256-2440265ac877\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:26.802818 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.802676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dc47687-277c-47d5-a256-2440265ac877-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr\" (UID: \"4dc47687-277c-47d5-a256-2440265ac877\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:26.802946 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.802925    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dc47687-277c-47d5-a256-2440265ac877-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr\" (UID: \"4dc47687-277c-47d5-a256-2440265ac877\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:26.802990 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.802971    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dc47687-277c-47d5-a256-2440265ac877-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr\" (UID: \"4dc47687-277c-47d5-a256-2440265ac877\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:26.813236 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.813205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5c2s\" (UniqueName: \"kubernetes.io/projected/4dc47687-277c-47d5-a256-2440265ac877-kube-api-access-g5c2s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr\" (UID: \"4dc47687-277c-47d5-a256-2440265ac877\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:26.861789 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.861748    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:26.995639 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:26.995611    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"]
Jul 10 21:27:26.997785 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:27:26.997757    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc47687_277c_47d5_a256_2440265ac877.slice/crio-e7fa38ad6bfdb84e22af86739c5c713126ec32c7e60f38ca8109029f6f9a0154 WatchSource:0}: Error finding container e7fa38ad6bfdb84e22af86739c5c713126ec32c7e60f38ca8109029f6f9a0154: Status 404 returned error can't find the container with id e7fa38ad6bfdb84e22af86739c5c713126ec32c7e60f38ca8109029f6f9a0154
Jul 10 21:27:27.157501 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.157463    2575 generic.go:356] "Generic (PLEG): container finished" podID="4dc47687-277c-47d5-a256-2440265ac877" containerID="a377b2149a9a5d6c6a75fc7258a0049da036cc92156bb6a6218da2f9ef69f37c" exitCode=0
Jul 10 21:27:27.157656 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.157545    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr" event={"ID":"4dc47687-277c-47d5-a256-2440265ac877","Type":"ContainerDied","Data":"a377b2149a9a5d6c6a75fc7258a0049da036cc92156bb6a6218da2f9ef69f37c"}
Jul 10 21:27:27.157656 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.157598    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr" event={"ID":"4dc47687-277c-47d5-a256-2440265ac877","Type":"ContainerStarted","Data":"e7fa38ad6bfdb84e22af86739c5c713126ec32c7e60f38ca8109029f6f9a0154"}
Jul 10 21:27:27.160882 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.160854    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"]
Jul 10 21:27:27.164299 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.164284    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:27.173539 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.173515    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"]
Jul 10 21:27:27.308523 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.308428    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j842s\" (UniqueName: \"kubernetes.io/projected/7516491e-b0ef-447a-97d8-a90c9d2eacca-kube-api-access-j842s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77\" (UID: \"7516491e-b0ef-447a-97d8-a90c9d2eacca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:27.308704 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.308566    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7516491e-b0ef-447a-97d8-a90c9d2eacca-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77\" (UID: \"7516491e-b0ef-447a-97d8-a90c9d2eacca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:27.308704 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.308620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7516491e-b0ef-447a-97d8-a90c9d2eacca-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77\" (UID: \"7516491e-b0ef-447a-97d8-a90c9d2eacca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:27.409850 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.409815    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j842s\" (UniqueName: \"kubernetes.io/projected/7516491e-b0ef-447a-97d8-a90c9d2eacca-kube-api-access-j842s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77\" (UID: \"7516491e-b0ef-447a-97d8-a90c9d2eacca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:27.410025 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.409905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7516491e-b0ef-447a-97d8-a90c9d2eacca-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77\" (UID: \"7516491e-b0ef-447a-97d8-a90c9d2eacca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:27.410025 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.409935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7516491e-b0ef-447a-97d8-a90c9d2eacca-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77\" (UID: \"7516491e-b0ef-447a-97d8-a90c9d2eacca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:27.410380 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.410360    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7516491e-b0ef-447a-97d8-a90c9d2eacca-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77\" (UID: \"7516491e-b0ef-447a-97d8-a90c9d2eacca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:27.410426 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.410359    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7516491e-b0ef-447a-97d8-a90c9d2eacca-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77\" (UID: \"7516491e-b0ef-447a-97d8-a90c9d2eacca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:27.421063 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.421038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j842s\" (UniqueName: \"kubernetes.io/projected/7516491e-b0ef-447a-97d8-a90c9d2eacca-kube-api-access-j842s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77\" (UID: \"7516491e-b0ef-447a-97d8-a90c9d2eacca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:27.473930 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.473889    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:27.559159 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.559094    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"]
Jul 10 21:27:27.564133 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.564110    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:27.573023 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.572994    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"]
Jul 10 21:27:27.610571 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.610546    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"]
Jul 10 21:27:27.612582 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:27:27.612556    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7516491e_b0ef_447a_97d8_a90c9d2eacca.slice/crio-5e244c04d9d41bfa78a26efe9b1a34ec4b125cfa36a4e5cff63032b1c405154d WatchSource:0}: Error finding container 5e244c04d9d41bfa78a26efe9b1a34ec4b125cfa36a4e5cff63032b1c405154d: Status 404 returned error can't find the container with id 5e244c04d9d41bfa78a26efe9b1a34ec4b125cfa36a4e5cff63032b1c405154d
Jul 10 21:27:27.713092 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.713062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d083ccdf-f370-4d97-9e42-5cf26dffe16a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d\" (UID: \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:27.713239 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.713101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d083ccdf-f370-4d97-9e42-5cf26dffe16a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d\" (UID: \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:27.713317 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.713248    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzq4z\" (UniqueName: \"kubernetes.io/projected/d083ccdf-f370-4d97-9e42-5cf26dffe16a-kube-api-access-bzq4z\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d\" (UID: \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:27.814092 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.814007    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzq4z\" (UniqueName: \"kubernetes.io/projected/d083ccdf-f370-4d97-9e42-5cf26dffe16a-kube-api-access-bzq4z\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d\" (UID: \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:27.814092 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.814060    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d083ccdf-f370-4d97-9e42-5cf26dffe16a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d\" (UID: \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:27.814092 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.814089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d083ccdf-f370-4d97-9e42-5cf26dffe16a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d\" (UID: \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:27.814506 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.814483    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d083ccdf-f370-4d97-9e42-5cf26dffe16a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d\" (UID: \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:27.814545 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.814496    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d083ccdf-f370-4d97-9e42-5cf26dffe16a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d\" (UID: \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:27.823301 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.823255    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzq4z\" (UniqueName: \"kubernetes.io/projected/d083ccdf-f370-4d97-9e42-5cf26dffe16a-kube-api-access-bzq4z\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d\" (UID: \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:27.876348 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.876312    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:27.949361 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.949329    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"]
Jul 10 21:27:27.953406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.953378    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:27.962103 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:27.962076    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"]
Jul 10 21:27:28.018142 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.018113    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"]
Jul 10 21:27:28.033630 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:27:28.033605    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd083ccdf_f370_4d97_9e42_5cf26dffe16a.slice/crio-a13ff24fc4f80b3218b1342bc91f06b46668adb9bd4531d0b415024bb6aaabb7 WatchSource:0}: Error finding container a13ff24fc4f80b3218b1342bc91f06b46668adb9bd4531d0b415024bb6aaabb7: Status 404 returned error can't find the container with id a13ff24fc4f80b3218b1342bc91f06b46668adb9bd4531d0b415024bb6aaabb7
Jul 10 21:27:28.117089 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.117058    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/628e9d85-049b-4e3b-be5f-e5fb5c236d29-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42\" (UID: \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:28.117233 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.117103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/628e9d85-049b-4e3b-be5f-e5fb5c236d29-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42\" (UID: \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:28.117233 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.117174    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp7rd\" (UniqueName: \"kubernetes.io/projected/628e9d85-049b-4e3b-be5f-e5fb5c236d29-kube-api-access-gp7rd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42\" (UID: \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:28.164628 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.164595    2575 generic.go:356] "Generic (PLEG): container finished" podID="4dc47687-277c-47d5-a256-2440265ac877" containerID="a1ce61166345e9a886a378b42cfbc7828b5247135e7fa1e2c4d7fa6ac50439f8" exitCode=0
Jul 10 21:27:28.164766 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.164675    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr" event={"ID":"4dc47687-277c-47d5-a256-2440265ac877","Type":"ContainerDied","Data":"a1ce61166345e9a886a378b42cfbc7828b5247135e7fa1e2c4d7fa6ac50439f8"}
Jul 10 21:27:28.166169 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.166150    2575 generic.go:356] "Generic (PLEG): container finished" podID="d083ccdf-f370-4d97-9e42-5cf26dffe16a" containerID="4a2bf3fbc723a1df75a79ecd8a205c31929bff183163a40c9116a05b605027c6" exitCode=0
Jul 10 21:27:28.166249 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.166211    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d" event={"ID":"d083ccdf-f370-4d97-9e42-5cf26dffe16a","Type":"ContainerDied","Data":"4a2bf3fbc723a1df75a79ecd8a205c31929bff183163a40c9116a05b605027c6"}
Jul 10 21:27:28.166324 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.166252    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d" event={"ID":"d083ccdf-f370-4d97-9e42-5cf26dffe16a","Type":"ContainerStarted","Data":"a13ff24fc4f80b3218b1342bc91f06b46668adb9bd4531d0b415024bb6aaabb7"}
Jul 10 21:27:28.167756 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.167737    2575 generic.go:356] "Generic (PLEG): container finished" podID="7516491e-b0ef-447a-97d8-a90c9d2eacca" containerID="dc341d5ac94018c7abded25153f00271974b351f425a4ff5095ef3ae14ec524e" exitCode=0
Jul 10 21:27:28.167865 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.167802    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77" event={"ID":"7516491e-b0ef-447a-97d8-a90c9d2eacca","Type":"ContainerDied","Data":"dc341d5ac94018c7abded25153f00271974b351f425a4ff5095ef3ae14ec524e"}
Jul 10 21:27:28.167865 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.167830    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77" event={"ID":"7516491e-b0ef-447a-97d8-a90c9d2eacca","Type":"ContainerStarted","Data":"5e244c04d9d41bfa78a26efe9b1a34ec4b125cfa36a4e5cff63032b1c405154d"}
Jul 10 21:27:28.217854 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.217826    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/628e9d85-049b-4e3b-be5f-e5fb5c236d29-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42\" (UID: \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:28.218006 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.217864    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/628e9d85-049b-4e3b-be5f-e5fb5c236d29-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42\" (UID: \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:28.218006 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.217975    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp7rd\" (UniqueName: \"kubernetes.io/projected/628e9d85-049b-4e3b-be5f-e5fb5c236d29-kube-api-access-gp7rd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42\" (UID: \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:28.218233 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.218210    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/628e9d85-049b-4e3b-be5f-e5fb5c236d29-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42\" (UID: \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:28.218316 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.218265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/628e9d85-049b-4e3b-be5f-e5fb5c236d29-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42\" (UID: \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:28.226754 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.226734    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp7rd\" (UniqueName: \"kubernetes.io/projected/628e9d85-049b-4e3b-be5f-e5fb5c236d29-kube-api-access-gp7rd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42\" (UID: \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:28.265264 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.265224    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:28.403674 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:28.401447    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"]
Jul 10 21:27:28.405536 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:27:28.405509    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628e9d85_049b_4e3b_be5f_e5fb5c236d29.slice/crio-adf04a1664cc6df10a09f9bd686294be35a6e186c0082cb9d6a94208328d3615 WatchSource:0}: Error finding container adf04a1664cc6df10a09f9bd686294be35a6e186c0082cb9d6a94208328d3615: Status 404 returned error can't find the container with id adf04a1664cc6df10a09f9bd686294be35a6e186c0082cb9d6a94208328d3615
Jul 10 21:27:29.174038 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:29.174010    2575 generic.go:356] "Generic (PLEG): container finished" podID="4dc47687-277c-47d5-a256-2440265ac877" containerID="008acd39aa60ed266bf162c4063e04427af3bb28938a798025c5b23c5f46324b" exitCode=0
Jul 10 21:27:29.174471 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:29.174091    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr" event={"ID":"4dc47687-277c-47d5-a256-2440265ac877","Type":"ContainerDied","Data":"008acd39aa60ed266bf162c4063e04427af3bb28938a798025c5b23c5f46324b"}
Jul 10 21:27:29.175634 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:29.175614    2575 generic.go:356] "Generic (PLEG): container finished" podID="d083ccdf-f370-4d97-9e42-5cf26dffe16a" containerID="5532e2b3728a3ad24b5874cea5f2b99a96eb8785c859199008ccb0914235301f" exitCode=0
Jul 10 21:27:29.175732 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:29.175682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d" event={"ID":"d083ccdf-f370-4d97-9e42-5cf26dffe16a","Type":"ContainerDied","Data":"5532e2b3728a3ad24b5874cea5f2b99a96eb8785c859199008ccb0914235301f"}
Jul 10 21:27:29.177129 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:29.177019    2575 generic.go:356] "Generic (PLEG): container finished" podID="628e9d85-049b-4e3b-be5f-e5fb5c236d29" containerID="85f264e3578472d4c65939fa7905ba42da91acf291dbf49a3871376c7488a337" exitCode=0
Jul 10 21:27:29.177129 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:29.177041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42" event={"ID":"628e9d85-049b-4e3b-be5f-e5fb5c236d29","Type":"ContainerDied","Data":"85f264e3578472d4c65939fa7905ba42da91acf291dbf49a3871376c7488a337"}
Jul 10 21:27:29.177129 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:29.177076    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42" event={"ID":"628e9d85-049b-4e3b-be5f-e5fb5c236d29","Type":"ContainerStarted","Data":"adf04a1664cc6df10a09f9bd686294be35a6e186c0082cb9d6a94208328d3615"}
Jul 10 21:27:30.187226 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.187194    2575 generic.go:356] "Generic (PLEG): container finished" podID="d083ccdf-f370-4d97-9e42-5cf26dffe16a" containerID="5c088ca07ae11ef37805ba9914995abadcf9de5e91b42ee3254f1f75c34d71b4" exitCode=0
Jul 10 21:27:30.187677 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.187289    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d" event={"ID":"d083ccdf-f370-4d97-9e42-5cf26dffe16a","Type":"ContainerDied","Data":"5c088ca07ae11ef37805ba9914995abadcf9de5e91b42ee3254f1f75c34d71b4"}
Jul 10 21:27:30.189113 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.189091    2575 generic.go:356] "Generic (PLEG): container finished" podID="7516491e-b0ef-447a-97d8-a90c9d2eacca" containerID="e88c83013f8a89c8471731efc01420d0e6cad46d1257572b590b9240ab7e8a2c" exitCode=0
Jul 10 21:27:30.189229 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.189172    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77" event={"ID":"7516491e-b0ef-447a-97d8-a90c9d2eacca","Type":"ContainerDied","Data":"e88c83013f8a89c8471731efc01420d0e6cad46d1257572b590b9240ab7e8a2c"}
Jul 10 21:27:30.355408 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.355382    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:30.435757 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.435729    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dc47687-277c-47d5-a256-2440265ac877-util\") pod \"4dc47687-277c-47d5-a256-2440265ac877\" (UID: \"4dc47687-277c-47d5-a256-2440265ac877\") "
Jul 10 21:27:30.435883 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.435781    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5c2s\" (UniqueName: \"kubernetes.io/projected/4dc47687-277c-47d5-a256-2440265ac877-kube-api-access-g5c2s\") pod \"4dc47687-277c-47d5-a256-2440265ac877\" (UID: \"4dc47687-277c-47d5-a256-2440265ac877\") "
Jul 10 21:27:30.435883 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.435818    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dc47687-277c-47d5-a256-2440265ac877-bundle\") pod \"4dc47687-277c-47d5-a256-2440265ac877\" (UID: \"4dc47687-277c-47d5-a256-2440265ac877\") "
Jul 10 21:27:30.436641 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.436610    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc47687-277c-47d5-a256-2440265ac877-bundle" (OuterVolumeSpecName: "bundle") pod "4dc47687-277c-47d5-a256-2440265ac877" (UID: "4dc47687-277c-47d5-a256-2440265ac877"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:27:30.437844 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.437782    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dc47687-277c-47d5-a256-2440265ac877-kube-api-access-g5c2s" (OuterVolumeSpecName: "kube-api-access-g5c2s") pod "4dc47687-277c-47d5-a256-2440265ac877" (UID: "4dc47687-277c-47d5-a256-2440265ac877"). InnerVolumeSpecName "kube-api-access-g5c2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:27:30.441016 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.440993    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc47687-277c-47d5-a256-2440265ac877-util" (OuterVolumeSpecName: "util") pod "4dc47687-277c-47d5-a256-2440265ac877" (UID: "4dc47687-277c-47d5-a256-2440265ac877"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:27:30.536356 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.536324    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dc47687-277c-47d5-a256-2440265ac877-util\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:30.536356 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.536357    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5c2s\" (UniqueName: \"kubernetes.io/projected/4dc47687-277c-47d5-a256-2440265ac877-kube-api-access-g5c2s\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:30.536550 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.536370    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dc47687-277c-47d5-a256-2440265ac877-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:30.788321 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:30.788235    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:31.198648 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.198617    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr"
Jul 10 21:27:31.199051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.198612    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr" event={"ID":"4dc47687-277c-47d5-a256-2440265ac877","Type":"ContainerDied","Data":"e7fa38ad6bfdb84e22af86739c5c713126ec32c7e60f38ca8109029f6f9a0154"}
Jul 10 21:27:31.199051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.198751    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7fa38ad6bfdb84e22af86739c5c713126ec32c7e60f38ca8109029f6f9a0154"
Jul 10 21:27:31.200595 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.200572    2575 generic.go:356] "Generic (PLEG): container finished" podID="7516491e-b0ef-447a-97d8-a90c9d2eacca" containerID="f246bd1990c2ba16ba0af6171cc560dceff8feaa29169f34c1ea2887c1d21d4c" exitCode=0
Jul 10 21:27:31.200733 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.200596    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77" event={"ID":"7516491e-b0ef-447a-97d8-a90c9d2eacca","Type":"ContainerDied","Data":"f246bd1990c2ba16ba0af6171cc560dceff8feaa29169f34c1ea2887c1d21d4c"}
Jul 10 21:27:31.202407 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.202386    2575 generic.go:356] "Generic (PLEG): container finished" podID="628e9d85-049b-4e3b-be5f-e5fb5c236d29" containerID="a35a1435a8d2a392b3ffe69aace6d7b6180888ebe36db8c6d0c942e19e8fe3aa" exitCode=0
Jul 10 21:27:31.202507 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.202471    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42" event={"ID":"628e9d85-049b-4e3b-be5f-e5fb5c236d29","Type":"ContainerDied","Data":"a35a1435a8d2a392b3ffe69aace6d7b6180888ebe36db8c6d0c942e19e8fe3aa"}
Jul 10 21:27:31.335836 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.335811    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:31.342164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.342141    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d083ccdf-f370-4d97-9e42-5cf26dffe16a-bundle\") pod \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\" (UID: \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\") "
Jul 10 21:27:31.342307 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.342205    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzq4z\" (UniqueName: \"kubernetes.io/projected/d083ccdf-f370-4d97-9e42-5cf26dffe16a-kube-api-access-bzq4z\") pod \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\" (UID: \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\") "
Jul 10 21:27:31.342307 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.342246    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d083ccdf-f370-4d97-9e42-5cf26dffe16a-util\") pod \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\" (UID: \"d083ccdf-f370-4d97-9e42-5cf26dffe16a\") "
Jul 10 21:27:31.343084 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.342989    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d083ccdf-f370-4d97-9e42-5cf26dffe16a-bundle" (OuterVolumeSpecName: "bundle") pod "d083ccdf-f370-4d97-9e42-5cf26dffe16a" (UID: "d083ccdf-f370-4d97-9e42-5cf26dffe16a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:27:31.352259 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.352220    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d083ccdf-f370-4d97-9e42-5cf26dffe16a-kube-api-access-bzq4z" (OuterVolumeSpecName: "kube-api-access-bzq4z") pod "d083ccdf-f370-4d97-9e42-5cf26dffe16a" (UID: "d083ccdf-f370-4d97-9e42-5cf26dffe16a"). InnerVolumeSpecName "kube-api-access-bzq4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:27:31.357195 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.357165    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d083ccdf-f370-4d97-9e42-5cf26dffe16a-util" (OuterVolumeSpecName: "util") pod "d083ccdf-f370-4d97-9e42-5cf26dffe16a" (UID: "d083ccdf-f370-4d97-9e42-5cf26dffe16a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:27:31.442850 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.442816    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d083ccdf-f370-4d97-9e42-5cf26dffe16a-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:31.442850 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.442847    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzq4z\" (UniqueName: \"kubernetes.io/projected/d083ccdf-f370-4d97-9e42-5cf26dffe16a-kube-api-access-bzq4z\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:31.442850 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:31.442858    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d083ccdf-f370-4d97-9e42-5cf26dffe16a-util\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:32.209210 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.209180    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d"
Jul 10 21:27:32.209685 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.209181    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d" event={"ID":"d083ccdf-f370-4d97-9e42-5cf26dffe16a","Type":"ContainerDied","Data":"a13ff24fc4f80b3218b1342bc91f06b46668adb9bd4531d0b415024bb6aaabb7"}
Jul 10 21:27:32.209685 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.209328    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a13ff24fc4f80b3218b1342bc91f06b46668adb9bd4531d0b415024bb6aaabb7"
Jul 10 21:27:32.211670 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.211642    2575 generic.go:356] "Generic (PLEG): container finished" podID="628e9d85-049b-4e3b-be5f-e5fb5c236d29" containerID="5cdcaf5ebd3201f0ab1614cf8b5af53890afc0bf3e14926fada36bb6c519ed2c" exitCode=0
Jul 10 21:27:32.211809 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.211733    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42" event={"ID":"628e9d85-049b-4e3b-be5f-e5fb5c236d29","Type":"ContainerDied","Data":"5cdcaf5ebd3201f0ab1614cf8b5af53890afc0bf3e14926fada36bb6c519ed2c"}
Jul 10 21:27:32.344958 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.344931    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:32.350710 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.350688    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7516491e-b0ef-447a-97d8-a90c9d2eacca-bundle\") pod \"7516491e-b0ef-447a-97d8-a90c9d2eacca\" (UID: \"7516491e-b0ef-447a-97d8-a90c9d2eacca\") "
Jul 10 21:27:32.350831 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.350749    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j842s\" (UniqueName: \"kubernetes.io/projected/7516491e-b0ef-447a-97d8-a90c9d2eacca-kube-api-access-j842s\") pod \"7516491e-b0ef-447a-97d8-a90c9d2eacca\" (UID: \"7516491e-b0ef-447a-97d8-a90c9d2eacca\") "
Jul 10 21:27:32.350831 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.350766    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7516491e-b0ef-447a-97d8-a90c9d2eacca-util\") pod \"7516491e-b0ef-447a-97d8-a90c9d2eacca\" (UID: \"7516491e-b0ef-447a-97d8-a90c9d2eacca\") "
Jul 10 21:27:32.351165 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.351144    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7516491e-b0ef-447a-97d8-a90c9d2eacca-bundle" (OuterVolumeSpecName: "bundle") pod "7516491e-b0ef-447a-97d8-a90c9d2eacca" (UID: "7516491e-b0ef-447a-97d8-a90c9d2eacca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:27:32.352780 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.352759    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7516491e-b0ef-447a-97d8-a90c9d2eacca-kube-api-access-j842s" (OuterVolumeSpecName: "kube-api-access-j842s") pod "7516491e-b0ef-447a-97d8-a90c9d2eacca" (UID: "7516491e-b0ef-447a-97d8-a90c9d2eacca"). InnerVolumeSpecName "kube-api-access-j842s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:27:32.356484 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.356444    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7516491e-b0ef-447a-97d8-a90c9d2eacca-util" (OuterVolumeSpecName: "util") pod "7516491e-b0ef-447a-97d8-a90c9d2eacca" (UID: "7516491e-b0ef-447a-97d8-a90c9d2eacca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:27:32.452297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.452227    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j842s\" (UniqueName: \"kubernetes.io/projected/7516491e-b0ef-447a-97d8-a90c9d2eacca-kube-api-access-j842s\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:32.452297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.452283    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7516491e-b0ef-447a-97d8-a90c9d2eacca-util\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:32.452297 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.452294    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7516491e-b0ef-447a-97d8-a90c9d2eacca-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:32.651736 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:32.651705    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:33.218023 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.217997    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77"
Jul 10 21:27:33.218421 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.218030    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77" event={"ID":"7516491e-b0ef-447a-97d8-a90c9d2eacca","Type":"ContainerDied","Data":"5e244c04d9d41bfa78a26efe9b1a34ec4b125cfa36a4e5cff63032b1c405154d"}
Jul 10 21:27:33.218421 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.218074    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e244c04d9d41bfa78a26efe9b1a34ec4b125cfa36a4e5cff63032b1c405154d"
Jul 10 21:27:33.347173 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.347147    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:33.359887 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.359863    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp7rd\" (UniqueName: \"kubernetes.io/projected/628e9d85-049b-4e3b-be5f-e5fb5c236d29-kube-api-access-gp7rd\") pod \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\" (UID: \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\") "
Jul 10 21:27:33.360002 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.359969    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/628e9d85-049b-4e3b-be5f-e5fb5c236d29-bundle\") pod \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\" (UID: \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\") "
Jul 10 21:27:33.360061 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.360003    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/628e9d85-049b-4e3b-be5f-e5fb5c236d29-util\") pod \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\" (UID: \"628e9d85-049b-4e3b-be5f-e5fb5c236d29\") "
Jul 10 21:27:33.360398 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.360376    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/628e9d85-049b-4e3b-be5f-e5fb5c236d29-bundle" (OuterVolumeSpecName: "bundle") pod "628e9d85-049b-4e3b-be5f-e5fb5c236d29" (UID: "628e9d85-049b-4e3b-be5f-e5fb5c236d29"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:27:33.361926 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.361901    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/628e9d85-049b-4e3b-be5f-e5fb5c236d29-kube-api-access-gp7rd" (OuterVolumeSpecName: "kube-api-access-gp7rd") pod "628e9d85-049b-4e3b-be5f-e5fb5c236d29" (UID: "628e9d85-049b-4e3b-be5f-e5fb5c236d29"). InnerVolumeSpecName "kube-api-access-gp7rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:27:33.365477 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.365445    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/628e9d85-049b-4e3b-be5f-e5fb5c236d29-util" (OuterVolumeSpecName: "util") pod "628e9d85-049b-4e3b-be5f-e5fb5c236d29" (UID: "628e9d85-049b-4e3b-be5f-e5fb5c236d29"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:27:33.460764 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.460731    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/628e9d85-049b-4e3b-be5f-e5fb5c236d29-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:33.460764 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.460759    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/628e9d85-049b-4e3b-be5f-e5fb5c236d29-util\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:33.460764 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:33.460770    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp7rd\" (UniqueName: \"kubernetes.io/projected/628e9d85-049b-4e3b-be5f-e5fb5c236d29-kube-api-access-gp7rd\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:27:34.223893 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:34.223864    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42"
Jul 10 21:27:34.224382 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:34.223900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42" event={"ID":"628e9d85-049b-4e3b-be5f-e5fb5c236d29","Type":"ContainerDied","Data":"adf04a1664cc6df10a09f9bd686294be35a6e186c0082cb9d6a94208328d3615"}
Jul 10 21:27:34.224382 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:34.223940    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="adf04a1664cc6df10a09f9bd686294be35a6e186c0082cb9d6a94208328d3615"
Jul 10 21:27:39.647835 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:39.647797    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:43.081330 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:43.081293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:44.439025 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.438990    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"]
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439318    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d083ccdf-f370-4d97-9e42-5cf26dffe16a" containerName="pull"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439329    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d083ccdf-f370-4d97-9e42-5cf26dffe16a" containerName="pull"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439337    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dc47687-277c-47d5-a256-2440265ac877" containerName="util"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439342    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dc47687-277c-47d5-a256-2440265ac877" containerName="util"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439352    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7516491e-b0ef-447a-97d8-a90c9d2eacca" containerName="util"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439358    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7516491e-b0ef-447a-97d8-a90c9d2eacca" containerName="util"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439365    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="628e9d85-049b-4e3b-be5f-e5fb5c236d29" containerName="extract"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439370    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="628e9d85-049b-4e3b-be5f-e5fb5c236d29" containerName="extract"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439376    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d083ccdf-f370-4d97-9e42-5cf26dffe16a" containerName="extract"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439382    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d083ccdf-f370-4d97-9e42-5cf26dffe16a" containerName="extract"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439390    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="628e9d85-049b-4e3b-be5f-e5fb5c236d29" containerName="pull"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439395    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="628e9d85-049b-4e3b-be5f-e5fb5c236d29" containerName="pull"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439403    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d083ccdf-f370-4d97-9e42-5cf26dffe16a" containerName="util"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439408    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d083ccdf-f370-4d97-9e42-5cf26dffe16a" containerName="util"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439416    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dc47687-277c-47d5-a256-2440265ac877" containerName="pull"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439420    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dc47687-277c-47d5-a256-2440265ac877" containerName="pull"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439426    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="628e9d85-049b-4e3b-be5f-e5fb5c236d29" containerName="util"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439431    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="628e9d85-049b-4e3b-be5f-e5fb5c236d29" containerName="util"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439440    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7516491e-b0ef-447a-97d8-a90c9d2eacca" containerName="pull"
Jul 10 21:27:44.439436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439445    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7516491e-b0ef-447a-97d8-a90c9d2eacca" containerName="pull"
Jul 10 21:27:44.440012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439451    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7516491e-b0ef-447a-97d8-a90c9d2eacca" containerName="extract"
Jul 10 21:27:44.440012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439456    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7516491e-b0ef-447a-97d8-a90c9d2eacca" containerName="extract"
Jul 10 21:27:44.440012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439463    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dc47687-277c-47d5-a256-2440265ac877" containerName="extract"
Jul 10 21:27:44.440012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439468    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dc47687-277c-47d5-a256-2440265ac877" containerName="extract"
Jul 10 21:27:44.440012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439514    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="628e9d85-049b-4e3b-be5f-e5fb5c236d29" containerName="extract"
Jul 10 21:27:44.440012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439521    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7516491e-b0ef-447a-97d8-a90c9d2eacca" containerName="extract"
Jul 10 21:27:44.440012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439528    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dc47687-277c-47d5-a256-2440265ac877" containerName="extract"
Jul 10 21:27:44.440012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.439535    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d083ccdf-f370-4d97-9e42-5cf26dffe16a" containerName="extract"
Jul 10 21:27:44.443538 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.443520    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:27:44.447146 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.447124    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8gqz6\""
Jul 10 21:27:44.457969 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.457944    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"]
Jul 10 21:27:44.545145 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.545101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8991a566-2466-4800-a3ba-8c6f43854288-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" (UID: \"8991a566-2466-4800-a3ba-8c6f43854288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:27:44.545374 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.545348    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pbmx\" (UniqueName: \"kubernetes.io/projected/8991a566-2466-4800-a3ba-8c6f43854288-kube-api-access-2pbmx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" (UID: \"8991a566-2466-4800-a3ba-8c6f43854288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:27:44.645781 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.645746    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pbmx\" (UniqueName: \"kubernetes.io/projected/8991a566-2466-4800-a3ba-8c6f43854288-kube-api-access-2pbmx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" (UID: \"8991a566-2466-4800-a3ba-8c6f43854288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:27:44.645988 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.645829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8991a566-2466-4800-a3ba-8c6f43854288-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" (UID: \"8991a566-2466-4800-a3ba-8c6f43854288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:27:44.646066 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.646031    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:44.646305 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.646257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8991a566-2466-4800-a3ba-8c6f43854288-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" (UID: \"8991a566-2466-4800-a3ba-8c6f43854288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:27:44.665405 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.665374    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pbmx\" (UniqueName: \"kubernetes.io/projected/8991a566-2466-4800-a3ba-8c6f43854288-kube-api-access-2pbmx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" (UID: \"8991a566-2466-4800-a3ba-8c6f43854288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:27:44.752748 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.752644    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:27:44.898226 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:44.898200    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"]
Jul 10 21:27:44.900414 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:27:44.900387    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8991a566_2466_4800_a3ba_8c6f43854288.slice/crio-6859bd472a29cda6a8213d34c26afcffb024a0b25f43b4c7721e119a02f875e4 WatchSource:0}: Error finding container 6859bd472a29cda6a8213d34c26afcffb024a0b25f43b4c7721e119a02f875e4: Status 404 returned error can't find the container with id 6859bd472a29cda6a8213d34c26afcffb024a0b25f43b4c7721e119a02f875e4
Jul 10 21:27:45.045808 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:45.045713    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:45.277935 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:45.277900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64" event={"ID":"8991a566-2466-4800-a3ba-8c6f43854288","Type":"ContainerStarted","Data":"6859bd472a29cda6a8213d34c26afcffb024a0b25f43b4c7721e119a02f875e4"}
Jul 10 21:27:46.090802 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:46.090760    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:47.036394 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:47.036360    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v"]
Jul 10 21:27:47.044021 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:47.044000    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v"
Jul 10 21:27:47.046609 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:47.046589    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-prnn9\""
Jul 10 21:27:47.058943 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:47.058914    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v"]
Jul 10 21:27:47.065549 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:47.065514    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc7pj\" (UniqueName: \"kubernetes.io/projected/1856280b-f2e1-4c32-b1a1-e7290bbc0dba-kube-api-access-mc7pj\") pod \"authorino-operator-75cc8d5cb7-tbm6v\" (UID: \"1856280b-f2e1-4c32-b1a1-e7290bbc0dba\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v"
Jul 10 21:27:47.166224 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:47.166181    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc7pj\" (UniqueName: \"kubernetes.io/projected/1856280b-f2e1-4c32-b1a1-e7290bbc0dba-kube-api-access-mc7pj\") pod \"authorino-operator-75cc8d5cb7-tbm6v\" (UID: \"1856280b-f2e1-4c32-b1a1-e7290bbc0dba\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v"
Jul 10 21:27:47.187319 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:47.187264    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc7pj\" (UniqueName: \"kubernetes.io/projected/1856280b-f2e1-4c32-b1a1-e7290bbc0dba-kube-api-access-mc7pj\") pod \"authorino-operator-75cc8d5cb7-tbm6v\" (UID: \"1856280b-f2e1-4c32-b1a1-e7290bbc0dba\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v"
Jul 10 21:27:47.354334 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:47.354294    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v"
Jul 10 21:27:47.504418 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:47.504388    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v"]
Jul 10 21:27:47.506795 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:27:47.506770    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1856280b_f2e1_4c32_b1a1_e7290bbc0dba.slice/crio-f440b4a7bd66a6805c70f93656d0ab392ee30a1f5ed932153fd29ac200fa1881 WatchSource:0}: Error finding container f440b4a7bd66a6805c70f93656d0ab392ee30a1f5ed932153fd29ac200fa1881: Status 404 returned error can't find the container with id f440b4a7bd66a6805c70f93656d0ab392ee30a1f5ed932153fd29ac200fa1881
Jul 10 21:27:47.646374 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:47.646260    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:48.297022 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:48.296912    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v" event={"ID":"1856280b-f2e1-4c32-b1a1-e7290bbc0dba","Type":"ContainerStarted","Data":"f440b4a7bd66a6805c70f93656d0ab392ee30a1f5ed932153fd29ac200fa1881"}
Jul 10 21:27:48.703561 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:48.703521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:49.041351 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:49.041242    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"]
Jul 10 21:27:49.048793 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:49.048751    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:27:49.052035 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:49.052004    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pxbz9\""
Jul 10 21:27:49.056354 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:49.056282    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"]
Jul 10 21:27:49.086097 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:49.086063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb4xr\" (UniqueName: \"kubernetes.io/projected/4f54958e-8fb7-43f1-b515-63b94d72d013-kube-api-access-pb4xr\") pod \"limitador-operator-controller-manager-859d7b78bd-84c9r\" (UID: \"4f54958e-8fb7-43f1-b515-63b94d72d013\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:27:49.186975 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:49.186939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb4xr\" (UniqueName: \"kubernetes.io/projected/4f54958e-8fb7-43f1-b515-63b94d72d013-kube-api-access-pb4xr\") pod \"limitador-operator-controller-manager-859d7b78bd-84c9r\" (UID: \"4f54958e-8fb7-43f1-b515-63b94d72d013\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:27:49.203369 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:49.203318    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb4xr\" (UniqueName: \"kubernetes.io/projected/4f54958e-8fb7-43f1-b515-63b94d72d013-kube-api-access-pb4xr\") pod \"limitador-operator-controller-manager-859d7b78bd-84c9r\" (UID: \"4f54958e-8fb7-43f1-b515-63b94d72d013\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:27:49.364048 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:49.364010    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:27:50.054819 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:50.054777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:51.062431 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:51.062400    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"]
Jul 10 21:27:51.065492 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:27:51.065465    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f54958e_8fb7_43f1_b515_63b94d72d013.slice/crio-605ddc4201acd27cdc07ec4d3086a8751a1919091ae8f816a1d8fceae1252863 WatchSource:0}: Error finding container 605ddc4201acd27cdc07ec4d3086a8751a1919091ae8f816a1d8fceae1252863: Status 404 returned error can't find the container with id 605ddc4201acd27cdc07ec4d3086a8751a1919091ae8f816a1d8fceae1252863
Jul 10 21:27:51.262352 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:51.262259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:51.314558 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:51.314527    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r" event={"ID":"4f54958e-8fb7-43f1-b515-63b94d72d013","Type":"ContainerStarted","Data":"605ddc4201acd27cdc07ec4d3086a8751a1919091ae8f816a1d8fceae1252863"}
Jul 10 21:27:51.316072 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:51.316051    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64" event={"ID":"8991a566-2466-4800-a3ba-8c6f43854288","Type":"ContainerStarted","Data":"795faf9b21b04e0ad61d93b5a0ae2f64815bf96ad0942289ff382aea2e3d5d9a"}
Jul 10 21:27:51.316183 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:51.316165    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:27:51.317648 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:51.317629    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v" event={"ID":"1856280b-f2e1-4c32-b1a1-e7290bbc0dba","Type":"ContainerStarted","Data":"d9e0c283c2d5c4f25e30c1083ba3e2f8b5877656ec08041f339d06e8b3b13378"}
Jul 10 21:27:51.317751 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:51.317739    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v"
Jul 10 21:27:51.340480 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:51.340426    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64" podStartSLOduration=1.31265686 podStartE2EDuration="7.340408121s" totalImagesPullingTime="6.027751261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:27:51.338376987 +0000 UTC m=+396.971622244" watchObservedRunningTime="2026-07-10 21:27:51.340408121 +0000 UTC m=+396.973653444"
Jul 10 21:27:51.355915 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:51.355864    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v" podStartSLOduration=0.947041961 podStartE2EDuration="4.355846756s" totalImagesPullingTime="3.408804795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:27:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:27:51.354230413 +0000 UTC m=+396.987475668" watchObservedRunningTime="2026-07-10 21:27:51.355846756 +0000 UTC m=+396.989092009"
Jul 10 21:27:53.330579 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:53.330545    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r" event={"ID":"4f54958e-8fb7-43f1-b515-63b94d72d013","Type":"ContainerStarted","Data":"4756326e76c7cdd814ff526a40466ae4ae74db279f35b18916fcb8b699d759a3"}
Jul 10 21:27:53.331042 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:53.330635    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:27:53.349157 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:53.349106    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r" podStartSLOduration=2.700584634 podStartE2EDuration="4.349088543s" totalImagesPullingTime="1.648503909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:27:53.34881389 +0000 UTC m=+398.982059145" watchObservedRunningTime="2026-07-10 21:27:53.349088543 +0000 UTC m=+398.982333799"
Jul 10 21:27:53.848512 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:53.848478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:53.914549 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:53.914505    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:54.004919 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.004880    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:54.351596 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.351563    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-659ccf6b49-7k5nt"]
Jul 10 21:27:54.354776 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.354761    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.370096 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.370066    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:54.371185 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.371163    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659ccf6b49-7k5nt"]
Jul 10 21:27:54.433753 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.433692    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d01283-9161-4544-9a8e-b4c9f222ecc8-console-oauth-config\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.433923 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.433797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjtlm\" (UniqueName: \"kubernetes.io/projected/86d01283-9161-4544-9a8e-b4c9f222ecc8-kube-api-access-wjtlm\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.433923 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.433823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d01283-9161-4544-9a8e-b4c9f222ecc8-console-config\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.433923 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.433851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d01283-9161-4544-9a8e-b4c9f222ecc8-trusted-ca-bundle\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.434026 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.433917    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d01283-9161-4544-9a8e-b4c9f222ecc8-service-ca\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.434026 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.433958    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d01283-9161-4544-9a8e-b4c9f222ecc8-console-serving-cert\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.434026 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.433975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d01283-9161-4544-9a8e-b4c9f222ecc8-oauth-serving-cert\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.463036 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.463007    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:54.535081 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.535044    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjtlm\" (UniqueName: \"kubernetes.io/projected/86d01283-9161-4544-9a8e-b4c9f222ecc8-kube-api-access-wjtlm\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.535081 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.535086    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d01283-9161-4544-9a8e-b4c9f222ecc8-console-config\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.535366 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.535120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d01283-9161-4544-9a8e-b4c9f222ecc8-trusted-ca-bundle\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.535366 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.535143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d01283-9161-4544-9a8e-b4c9f222ecc8-service-ca\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.535366 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.535163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d01283-9161-4544-9a8e-b4c9f222ecc8-console-serving-cert\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.535366 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.535184    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d01283-9161-4544-9a8e-b4c9f222ecc8-oauth-serving-cert\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.535366 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.535219    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d01283-9161-4544-9a8e-b4c9f222ecc8-console-oauth-config\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.535846 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.535827    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d01283-9161-4544-9a8e-b4c9f222ecc8-service-ca\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.535923 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.535910    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d01283-9161-4544-9a8e-b4c9f222ecc8-oauth-serving-cert\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.536058 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.536033    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d01283-9161-4544-9a8e-b4c9f222ecc8-trusted-ca-bundle\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.536326 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.536309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d01283-9161-4544-9a8e-b4c9f222ecc8-console-config\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.537748 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.537724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d01283-9161-4544-9a8e-b4c9f222ecc8-console-serving-cert\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.537970 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.537946    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d01283-9161-4544-9a8e-b4c9f222ecc8-console-oauth-config\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.543191 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.543172    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjtlm\" (UniqueName: \"kubernetes.io/projected/86d01283-9161-4544-9a8e-b4c9f222ecc8-kube-api-access-wjtlm\") pod \"console-659ccf6b49-7k5nt\" (UID: \"86d01283-9161-4544-9a8e-b4c9f222ecc8\") " pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.564882 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.564843    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:54.663614 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.663584    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:27:54.664307 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.664250    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:54.803870 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:54.803847    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659ccf6b49-7k5nt"]
Jul 10 21:27:54.805918 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:27:54.805893    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d01283_9161_4544_9a8e_b4c9f222ecc8.slice/crio-b5ea20075d12e920d563758860023c9963ecbc68d953e289f8e0c768cc27a4a3 WatchSource:0}: Error finding container b5ea20075d12e920d563758860023c9963ecbc68d953e289f8e0c768cc27a4a3: Status 404 returned error can't find the container with id b5ea20075d12e920d563758860023c9963ecbc68d953e289f8e0c768cc27a4a3
Jul 10 21:27:55.153826 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:55.153787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:55.281828 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:55.281793    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:27:55.342879 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:55.342847    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659ccf6b49-7k5nt" event={"ID":"86d01283-9161-4544-9a8e-b4c9f222ecc8","Type":"ContainerStarted","Data":"c2720a1e24d1edce0d12bce412d9d1e44a2a3601f5fc1c0472461056aff791b8"}
Jul 10 21:27:55.343050 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:55.342895    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659ccf6b49-7k5nt" event={"ID":"86d01283-9161-4544-9a8e-b4c9f222ecc8","Type":"ContainerStarted","Data":"b5ea20075d12e920d563758860023c9963ecbc68d953e289f8e0c768cc27a4a3"}
Jul 10 21:27:55.374450 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:27:55.374400    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-659ccf6b49-7k5nt" podStartSLOduration=1.37438348 podStartE2EDuration="1.37438348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:27:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:27:55.371480896 +0000 UTC m=+401.004726150" watchObservedRunningTime="2026-07-10 21:27:55.37438348 +0000 UTC m=+401.007628734"
Jul 10 21:28:02.326131 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:02.326101    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tbm6v"
Jul 10 21:28:02.326545 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:02.326172    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:03.920485 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:03.920452    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:04.019944 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.019911    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:04.144707 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.144672    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"]
Jul 10 21:28:04.144925 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.144896    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64" podUID="8991a566-2466-4800-a3ba-8c6f43854288" containerName="manager" containerID="cri-o://795faf9b21b04e0ad61d93b5a0ae2f64815bf96ad0942289ff382aea2e3d5d9a" gracePeriod=2
Jul 10 21:28:04.152000 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.151963    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"]
Jul 10 21:28:04.172401 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.172326    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"]
Jul 10 21:28:04.172664 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.172634    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" containerName="manager" containerID="cri-o://4756326e76c7cdd814ff526a40466ae4ae74db279f35b18916fcb8b699d759a3" gracePeriod=2
Jul 10 21:28:04.175436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.175410    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:04.176657 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.176623    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"]
Jul 10 21:28:04.178117 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.178084    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84c9r\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:04.181210 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.181063    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="8991a566-2466-4800-a3ba-8c6f43854288" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:04.182340 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.182319    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"]
Jul 10 21:28:04.182758 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.182743    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8991a566-2466-4800-a3ba-8c6f43854288" containerName="manager"
Jul 10 21:28:04.182810 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.182761    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8991a566-2466-4800-a3ba-8c6f43854288" containerName="manager"
Jul 10 21:28:04.182810 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.182787    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" containerName="manager"
Jul 10 21:28:04.182810 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.182793    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" containerName="manager"
Jul 10 21:28:04.182934 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.182922    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8991a566-2466-4800-a3ba-8c6f43854288" containerName="manager"
Jul 10 21:28:04.182974 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.182941    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" containerName="manager"
Jul 10 21:28:04.183246 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.183223    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="8991a566-2466-4800-a3ba-8c6f43854288" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:04.186145 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.186116    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84c9r\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:04.186313 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.186300    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"
Jul 10 21:28:04.191334 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.191302    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="8991a566-2466-4800-a3ba-8c6f43854288" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:04.193157 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.193130    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84c9r\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:04.207366 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.207332    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"]
Jul 10 21:28:04.209175 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.209154    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k"]
Jul 10 21:28:04.212546 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.212529    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k"
Jul 10 21:28:04.222650 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.222612    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="8991a566-2466-4800-a3ba-8c6f43854288" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:04.224725 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.224689    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84c9r\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:04.226017 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.225996    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k"]
Jul 10 21:28:04.320345 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.320309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9sb5\" (UniqueName: \"kubernetes.io/projected/e550e4f3-3bc4-4402-a9f4-bb38f7aa4f52-kube-api-access-t9sb5\") pod \"limitador-operator-controller-manager-859d7b78bd-wd75k\" (UID: \"e550e4f3-3bc4-4402-a9f4-bb38f7aa4f52\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k"
Jul 10 21:28:04.320509 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.320367    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d97915-c2a0-4482-8880-c31940e6090b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wvng6\" (UID: \"89d97915-c2a0-4482-8880-c31940e6090b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"
Jul 10 21:28:04.320509 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.320468    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psw7w\" (UniqueName: \"kubernetes.io/projected/89d97915-c2a0-4482-8880-c31940e6090b-kube-api-access-psw7w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wvng6\" (UID: \"89d97915-c2a0-4482-8880-c31940e6090b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"
Jul 10 21:28:04.389355 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.389325    2575 generic.go:356] "Generic (PLEG): container finished" podID="8991a566-2466-4800-a3ba-8c6f43854288" containerID="795faf9b21b04e0ad61d93b5a0ae2f64815bf96ad0942289ff382aea2e3d5d9a" exitCode=0
Jul 10 21:28:04.391144 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.391115    2575 generic.go:356] "Generic (PLEG): container finished" podID="4f54958e-8fb7-43f1-b515-63b94d72d013" containerID="4756326e76c7cdd814ff526a40466ae4ae74db279f35b18916fcb8b699d759a3" exitCode=0
Jul 10 21:28:04.421198 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.421168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9sb5\" (UniqueName: \"kubernetes.io/projected/e550e4f3-3bc4-4402-a9f4-bb38f7aa4f52-kube-api-access-t9sb5\") pod \"limitador-operator-controller-manager-859d7b78bd-wd75k\" (UID: \"e550e4f3-3bc4-4402-a9f4-bb38f7aa4f52\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k"
Jul 10 21:28:04.421362 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.421215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d97915-c2a0-4482-8880-c31940e6090b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wvng6\" (UID: \"89d97915-c2a0-4482-8880-c31940e6090b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"
Jul 10 21:28:04.421362 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.421264    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psw7w\" (UniqueName: \"kubernetes.io/projected/89d97915-c2a0-4482-8880-c31940e6090b-kube-api-access-psw7w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wvng6\" (UID: \"89d97915-c2a0-4482-8880-c31940e6090b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"
Jul 10 21:28:04.421631 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.421610    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d97915-c2a0-4482-8880-c31940e6090b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wvng6\" (UID: \"89d97915-c2a0-4482-8880-c31940e6090b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"
Jul 10 21:28:04.428566 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.428499    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:04.430889 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.430855    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84c9r\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:04.431403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.431382    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:04.433403 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.433368    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="8991a566-2466-4800-a3ba-8c6f43854288" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:04.435179 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.435154    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psw7w\" (UniqueName: \"kubernetes.io/projected/89d97915-c2a0-4482-8880-c31940e6090b-kube-api-access-psw7w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wvng6\" (UID: \"89d97915-c2a0-4482-8880-c31940e6090b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"
Jul 10 21:28:04.435727 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.435711    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9sb5\" (UniqueName: \"kubernetes.io/projected/e550e4f3-3bc4-4402-a9f4-bb38f7aa4f52-kube-api-access-t9sb5\") pod \"limitador-operator-controller-manager-859d7b78bd-wd75k\" (UID: \"e550e4f3-3bc4-4402-a9f4-bb38f7aa4f52\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k"
Jul 10 21:28:04.437452 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.437428    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="8991a566-2466-4800-a3ba-8c6f43854288" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:04.440339 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.440316    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84c9r\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:04.522247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.522216    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb4xr\" (UniqueName: \"kubernetes.io/projected/4f54958e-8fb7-43f1-b515-63b94d72d013-kube-api-access-pb4xr\") pod \"4f54958e-8fb7-43f1-b515-63b94d72d013\" (UID: \"4f54958e-8fb7-43f1-b515-63b94d72d013\") "
Jul 10 21:28:04.522443 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.522268    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8991a566-2466-4800-a3ba-8c6f43854288-extensions-socket-volume\") pod \"8991a566-2466-4800-a3ba-8c6f43854288\" (UID: \"8991a566-2466-4800-a3ba-8c6f43854288\") "
Jul 10 21:28:04.522443 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.522343    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pbmx\" (UniqueName: \"kubernetes.io/projected/8991a566-2466-4800-a3ba-8c6f43854288-kube-api-access-2pbmx\") pod \"8991a566-2466-4800-a3ba-8c6f43854288\" (UID: \"8991a566-2466-4800-a3ba-8c6f43854288\") "
Jul 10 21:28:04.522791 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.522761    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8991a566-2466-4800-a3ba-8c6f43854288-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8991a566-2466-4800-a3ba-8c6f43854288" (UID: "8991a566-2466-4800-a3ba-8c6f43854288"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:28:04.524498 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.524473    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f54958e-8fb7-43f1-b515-63b94d72d013-kube-api-access-pb4xr" (OuterVolumeSpecName: "kube-api-access-pb4xr") pod "4f54958e-8fb7-43f1-b515-63b94d72d013" (UID: "4f54958e-8fb7-43f1-b515-63b94d72d013"). InnerVolumeSpecName "kube-api-access-pb4xr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:28:04.524599 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.524506    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8991a566-2466-4800-a3ba-8c6f43854288-kube-api-access-2pbmx" (OuterVolumeSpecName: "kube-api-access-2pbmx") pod "8991a566-2466-4800-a3ba-8c6f43854288" (UID: "8991a566-2466-4800-a3ba-8c6f43854288"). InnerVolumeSpecName "kube-api-access-2pbmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:28:04.599509 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.599467    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"
Jul 10 21:28:04.606108 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.606072    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k"
Jul 10 21:28:04.623427 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.623400    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb4xr\" (UniqueName: \"kubernetes.io/projected/4f54958e-8fb7-43f1-b515-63b94d72d013-kube-api-access-pb4xr\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:28:04.623427 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.623426    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8991a566-2466-4800-a3ba-8c6f43854288-extensions-socket-volume\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:28:04.623587 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.623437    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pbmx\" (UniqueName: \"kubernetes.io/projected/8991a566-2466-4800-a3ba-8c6f43854288-kube-api-access-2pbmx\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:28:04.664540 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.664491    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:28:04.664757 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.664737    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:28:04.671387 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.671135    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:28:04.712513 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.712105    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="8991a566-2466-4800-a3ba-8c6f43854288" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:04.714958 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:04.714919    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84c9r\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:04.752181 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.752155    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k"]
Jul 10 21:28:04.753053 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:28:04.753019    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode550e4f3_3bc4_4402_a9f4_bb38f7aa4f52.slice/crio-61cf7a41daaaabc4cca8e0c6ee88a5d149f22e3c6c6213c2071a2f3e55e0207d WatchSource:0}: Error finding container 61cf7a41daaaabc4cca8e0c6ee88a5d149f22e3c6c6213c2071a2f3e55e0207d: Status 404 returned error can't find the container with id 61cf7a41daaaabc4cca8e0c6ee88a5d149f22e3c6c6213c2071a2f3e55e0207d
Jul 10 21:28:04.773784 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:04.773762    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"]
Jul 10 21:28:04.776623 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:28:04.776598    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d97915_c2a0_4482_8880_c31940e6090b.slice/crio-3286ed0abf3486fd62b0bdd4c42fc37670a84d7e2acdc7ece61b5742d46300fe WatchSource:0}: Error finding container 3286ed0abf3486fd62b0bdd4c42fc37670a84d7e2acdc7ece61b5742d46300fe: Status 404 returned error can't find the container with id 3286ed0abf3486fd62b0bdd4c42fc37670a84d7e2acdc7ece61b5742d46300fe
Jul 10 21:28:05.404158 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.404129    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:05.404158 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.404124    2575 scope.go:117] "RemoveContainer" containerID="795faf9b21b04e0ad61d93b5a0ae2f64815bf96ad0942289ff382aea2e3d5d9a"
Jul 10 21:28:05.406145 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.406110    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6" event={"ID":"89d97915-c2a0-4482-8880-c31940e6090b","Type":"ContainerStarted","Data":"994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672"}
Jul 10 21:28:05.406308 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.406208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6" event={"ID":"89d97915-c2a0-4482-8880-c31940e6090b","Type":"ContainerStarted","Data":"3286ed0abf3486fd62b0bdd4c42fc37670a84d7e2acdc7ece61b5742d46300fe"}
Jul 10 21:28:05.406308 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.406241    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"
Jul 10 21:28:05.407021 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:05.406998    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="8991a566-2466-4800-a3ba-8c6f43854288" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:05.407769 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.407664    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:05.409334 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:05.409305    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84c9r\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:05.409860 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.409838    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k" event={"ID":"e550e4f3-3bc4-4402-a9f4-bb38f7aa4f52","Type":"ContainerStarted","Data":"6238ca08722900e2875109f108f09cb20b52d784f4e2c481284994cef144596a"}
Jul 10 21:28:05.410159 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.410139    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k" event={"ID":"e550e4f3-3bc4-4402-a9f4-bb38f7aa4f52","Type":"ContainerStarted","Data":"61cf7a41daaaabc4cca8e0c6ee88a5d149f22e3c6c6213c2071a2f3e55e0207d"}
Jul 10 21:28:05.410304 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.410285    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k"
Jul 10 21:28:05.414562 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.414540    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-659ccf6b49-7k5nt"
Jul 10 21:28:05.415214 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.415197    2575 scope.go:117] "RemoveContainer" containerID="4756326e76c7cdd814ff526a40466ae4ae74db279f35b18916fcb8b699d759a3"
Jul 10 21:28:05.432733 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.432662    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6" podStartSLOduration=1.43263798 podStartE2EDuration="1.43263798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:28:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:28:05.430963059 +0000 UTC m=+411.064208314" watchObservedRunningTime="2026-07-10 21:28:05.43263798 +0000 UTC m=+411.065883235"
Jul 10 21:28:05.433426 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:05.433218    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="8991a566-2466-4800-a3ba-8c6f43854288" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:05.435419 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:05.435383    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84c9r\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:05.461105 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:05.461007    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="8991a566-2466-4800-a3ba-8c6f43854288" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:05.463131 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:05.463100    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84c9r\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:05.483024 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.482966    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k" podStartSLOduration=1.482947799 podStartE2EDuration="1.482947799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:28:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:28:05.482832999 +0000 UTC m=+411.116078254" watchObservedRunningTime="2026-07-10 21:28:05.482947799 +0000 UTC m=+411.116193054"
Jul 10 21:28:05.495022 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.494992    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69588d6b5-jtgpl"]
Jul 10 21:28:05.517851 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:05.517808    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="8991a566-2466-4800-a3ba-8c6f43854288" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:05.519817 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:05.519787    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84c9r\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:05.524326 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.524292    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" path="/var/lib/kubelet/pods/4f54958e-8fb7-43f1-b515-63b94d72d013/volumes"
Jul 10 21:28:05.524708 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.524690    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8991a566-2466-4800-a3ba-8c6f43854288" path="/var/lib/kubelet/pods/8991a566-2466-4800-a3ba-8c6f43854288/volumes"
Jul 10 21:28:05.525218 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:05.525191    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tfp64\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="8991a566-2466-4800-a3ba-8c6f43854288" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tfp64"
Jul 10 21:28:05.527312 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:05.527289    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84c9r\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="4f54958e-8fb7-43f1-b515-63b94d72d013" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84c9r"
Jul 10 21:28:05.643011 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.642979    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:05.743452 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.743365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:05.851937 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:05.851904    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:06.882711 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:06.882679    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:06.988476 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:06.988442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:09.297522 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:09.297488    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:09.398461 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:09.398431    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:15.058029 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:15.057994    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:15.156578 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:15.156544    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:16.419676 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:16.419647    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"
Jul 10 21:28:17.424407 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:17.424375    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wd75k"
Jul 10 21:28:25.452410 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:25.452373    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:25.508676 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:25.508644    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:26.051510 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:26.051474    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:26.118372 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:26.118328    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:29.453097 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:29.453058    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:29.556179 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:29.556148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:30.522909 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.522868    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69588d6b5-jtgpl" podUID="66490324-217b-44f7-84e2-02fafa30d484" containerName="console" containerID="cri-o://8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6" gracePeriod=15
Jul 10 21:28:30.769647 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.769623    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:28:30.853334 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.853304    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-trusted-ca-bundle\") pod \"66490324-217b-44f7-84e2-02fafa30d484\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") "
Jul 10 21:28:30.853334 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.853340    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px5p7\" (UniqueName: \"kubernetes.io/projected/66490324-217b-44f7-84e2-02fafa30d484-kube-api-access-px5p7\") pod \"66490324-217b-44f7-84e2-02fafa30d484\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") "
Jul 10 21:28:30.853560 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.853357    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-service-ca\") pod \"66490324-217b-44f7-84e2-02fafa30d484\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") "
Jul 10 21:28:30.853560 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.853375    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-oauth-serving-cert\") pod \"66490324-217b-44f7-84e2-02fafa30d484\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") "
Jul 10 21:28:30.853560 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.853429    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-console-config\") pod \"66490324-217b-44f7-84e2-02fafa30d484\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") "
Jul 10 21:28:30.853560 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.853452    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66490324-217b-44f7-84e2-02fafa30d484-console-oauth-config\") pod \"66490324-217b-44f7-84e2-02fafa30d484\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") "
Jul 10 21:28:30.853560 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.853480    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66490324-217b-44f7-84e2-02fafa30d484-console-serving-cert\") pod \"66490324-217b-44f7-84e2-02fafa30d484\" (UID: \"66490324-217b-44f7-84e2-02fafa30d484\") "
Jul 10 21:28:30.853878 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.853721    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-service-ca" (OuterVolumeSpecName: "service-ca") pod "66490324-217b-44f7-84e2-02fafa30d484" (UID: "66490324-217b-44f7-84e2-02fafa30d484"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:28:30.854004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.853967    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-console-config" (OuterVolumeSpecName: "console-config") pod "66490324-217b-44f7-84e2-02fafa30d484" (UID: "66490324-217b-44f7-84e2-02fafa30d484"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:28:30.854004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.853985    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "66490324-217b-44f7-84e2-02fafa30d484" (UID: "66490324-217b-44f7-84e2-02fafa30d484"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:28:30.854126 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.854103    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "66490324-217b-44f7-84e2-02fafa30d484" (UID: "66490324-217b-44f7-84e2-02fafa30d484"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:28:30.855627 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.855605    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66490324-217b-44f7-84e2-02fafa30d484-kube-api-access-px5p7" (OuterVolumeSpecName: "kube-api-access-px5p7") pod "66490324-217b-44f7-84e2-02fafa30d484" (UID: "66490324-217b-44f7-84e2-02fafa30d484"). InnerVolumeSpecName "kube-api-access-px5p7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:28:30.856004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.855981    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66490324-217b-44f7-84e2-02fafa30d484-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "66490324-217b-44f7-84e2-02fafa30d484" (UID: "66490324-217b-44f7-84e2-02fafa30d484"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:28:30.856105 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.856032    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66490324-217b-44f7-84e2-02fafa30d484-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "66490324-217b-44f7-84e2-02fafa30d484" (UID: "66490324-217b-44f7-84e2-02fafa30d484"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:28:30.954744 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.954706    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66490324-217b-44f7-84e2-02fafa30d484-console-oauth-config\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:28:30.954744 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.954736    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66490324-217b-44f7-84e2-02fafa30d484-console-serving-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:28:30.954744 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.954748    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-trusted-ca-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:28:30.954976 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.954758    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-px5p7\" (UniqueName: \"kubernetes.io/projected/66490324-217b-44f7-84e2-02fafa30d484-kube-api-access-px5p7\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:28:30.954976 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.954767    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:28:30.954976 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.954776    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-oauth-serving-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:28:30.954976 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:30.954785    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66490324-217b-44f7-84e2-02fafa30d484-console-config\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:28:31.546663 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:31.546627    2575 generic.go:356] "Generic (PLEG): container finished" podID="66490324-217b-44f7-84e2-02fafa30d484" containerID="8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6" exitCode=0
Jul 10 21:28:31.546663 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:31.546666    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69588d6b5-jtgpl"
Jul 10 21:28:31.547094 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:31.546699    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69588d6b5-jtgpl" event={"ID":"66490324-217b-44f7-84e2-02fafa30d484","Type":"ContainerDied","Data":"8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6"}
Jul 10 21:28:31.547094 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:31.546741    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69588d6b5-jtgpl" event={"ID":"66490324-217b-44f7-84e2-02fafa30d484","Type":"ContainerDied","Data":"5faad587ede0de9c44db58f1e17646e2ee901fe7d9b5a6c877048eaea1e11359"}
Jul 10 21:28:31.547094 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:31.546763    2575 scope.go:117] "RemoveContainer" containerID="8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6"
Jul 10 21:28:31.555146 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:31.555129    2575 scope.go:117] "RemoveContainer" containerID="8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6"
Jul 10 21:28:31.555455 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:31.555427    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6\": container with ID starting with 8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6 not found: ID does not exist" containerID="8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6"
Jul 10 21:28:31.555536 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:31.555467    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6"} err="failed to get container status \"8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6\": rpc error: code = NotFound desc = could not find container \"8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6\": container with ID starting with 8c64e3d24e14e36c993d89199ea0994586c9a65ce5104559fef24894a42aa4b6 not found: ID does not exist"
Jul 10 21:28:31.563551 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:31.563525    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69588d6b5-jtgpl"]
Jul 10 21:28:31.569204 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:31.569182    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69588d6b5-jtgpl"]
Jul 10 21:28:31.647318 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:31.647266    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:31.749827 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:31.749792    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:33.522725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:33.522689    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66490324-217b-44f7-84e2-02fafa30d484" path="/var/lib/kubelet/pods/66490324-217b-44f7-84e2-02fafa30d484/volumes"
Jul 10 21:28:34.017946 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.017907    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"]
Jul 10 21:28:34.018216 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.018191    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6" podUID="89d97915-c2a0-4482-8880-c31940e6090b" containerName="manager" containerID="cri-o://994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672" gracePeriod=10
Jul 10 21:28:34.266256 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.266230    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"
Jul 10 21:28:34.280821 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.280750    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psw7w\" (UniqueName: \"kubernetes.io/projected/89d97915-c2a0-4482-8880-c31940e6090b-kube-api-access-psw7w\") pod \"89d97915-c2a0-4482-8880-c31940e6090b\" (UID: \"89d97915-c2a0-4482-8880-c31940e6090b\") "
Jul 10 21:28:34.280821 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.280788    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d97915-c2a0-4482-8880-c31940e6090b-extensions-socket-volume\") pod \"89d97915-c2a0-4482-8880-c31940e6090b\" (UID: \"89d97915-c2a0-4482-8880-c31940e6090b\") "
Jul 10 21:28:34.281245 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.281207    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d97915-c2a0-4482-8880-c31940e6090b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "89d97915-c2a0-4482-8880-c31940e6090b" (UID: "89d97915-c2a0-4482-8880-c31940e6090b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:28:34.282920 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.282895    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89d97915-c2a0-4482-8880-c31940e6090b-kube-api-access-psw7w" (OuterVolumeSpecName: "kube-api-access-psw7w") pod "89d97915-c2a0-4482-8880-c31940e6090b" (UID: "89d97915-c2a0-4482-8880-c31940e6090b"). InnerVolumeSpecName "kube-api-access-psw7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:28:34.382267 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.382229    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psw7w\" (UniqueName: \"kubernetes.io/projected/89d97915-c2a0-4482-8880-c31940e6090b-kube-api-access-psw7w\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:28:34.382267 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.382262    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d97915-c2a0-4482-8880-c31940e6090b-extensions-socket-volume\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:28:34.567999 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.567909    2575 generic.go:356] "Generic (PLEG): container finished" podID="89d97915-c2a0-4482-8880-c31940e6090b" containerID="994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672" exitCode=0
Jul 10 21:28:34.567999 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.567954    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"
Jul 10 21:28:34.568434 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.567998    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6" event={"ID":"89d97915-c2a0-4482-8880-c31940e6090b","Type":"ContainerDied","Data":"994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672"}
Jul 10 21:28:34.568434 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.568056    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6" event={"ID":"89d97915-c2a0-4482-8880-c31940e6090b","Type":"ContainerDied","Data":"3286ed0abf3486fd62b0bdd4c42fc37670a84d7e2acdc7ece61b5742d46300fe"}
Jul 10 21:28:34.568434 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.568084    2575 scope.go:117] "RemoveContainer" containerID="994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672"
Jul 10 21:28:34.578973 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.577687    2575 scope.go:117] "RemoveContainer" containerID="994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672"
Jul 10 21:28:34.578973 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:28:34.578386    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672\": container with ID starting with 994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672 not found: ID does not exist" containerID="994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672"
Jul 10 21:28:34.578973 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.578419    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672"} err="failed to get container status \"994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672\": rpc error: code = NotFound desc = could not find container \"994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672\": container with ID starting with 994c0987ce4866187752f942049205bfca9818a74a974ffa3c5662123235a672 not found: ID does not exist"
Jul 10 21:28:34.593076 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.593047    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"]
Jul 10 21:28:34.597344 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:34.597321    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wvng6"]
Jul 10 21:28:35.522536 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:35.522506    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89d97915-c2a0-4482-8880-c31940e6090b" path="/var/lib/kubelet/pods/89d97915-c2a0-4482-8880-c31940e6090b/volumes"
Jul 10 21:28:50.474742 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.474545    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"]
Jul 10 21:28:50.475133 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.475003    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66490324-217b-44f7-84e2-02fafa30d484" containerName="console"
Jul 10 21:28:50.475133 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.475021    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="66490324-217b-44f7-84e2-02fafa30d484" containerName="console"
Jul 10 21:28:50.475133 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.475035    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89d97915-c2a0-4482-8880-c31940e6090b" containerName="manager"
Jul 10 21:28:50.475133 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.475043    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="89d97915-c2a0-4482-8880-c31940e6090b" containerName="manager"
Jul 10 21:28:50.475391 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.475176    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="89d97915-c2a0-4482-8880-c31940e6090b" containerName="manager"
Jul 10 21:28:50.475391 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.475191    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="66490324-217b-44f7-84e2-02fafa30d484" containerName="console"
Jul 10 21:28:50.477360 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.477341    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.479889 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.479867    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 21:28:50.479989 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.479867    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cv9pq\""
Jul 10 21:28:50.488777 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.488752    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"]
Jul 10 21:28:50.507925 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.507858    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:50.605400 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.605360    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.605595 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.605417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.605595 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.605445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.605595 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.605477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbxkn\" (UniqueName: \"kubernetes.io/projected/196f85b0-a352-4c0a-8591-5fd20046d8d9-kube-api-access-fbxkn\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.605595 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.605511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/196f85b0-a352-4c0a-8591-5fd20046d8d9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.605595 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.605534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.605595 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.605568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/196f85b0-a352-4c0a-8591-5fd20046d8d9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.605830 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.605649    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.605830 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.605688    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/196f85b0-a352-4c0a-8591-5fd20046d8d9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.706261 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.706226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.706439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.706266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.706439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.706308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.706439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.706326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbxkn\" (UniqueName: \"kubernetes.io/projected/196f85b0-a352-4c0a-8591-5fd20046d8d9-kube-api-access-fbxkn\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.706439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.706349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/196f85b0-a352-4c0a-8591-5fd20046d8d9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.706439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.706364    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.706439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.706394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/196f85b0-a352-4c0a-8591-5fd20046d8d9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.706439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.706438    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.706799 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.706475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/196f85b0-a352-4c0a-8591-5fd20046d8d9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.706799 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.706722    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.706799 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.706758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.706965 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.706860    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.707037 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.707017    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/196f85b0-a352-4c0a-8591-5fd20046d8d9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.707120 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.707103    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.708685 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.708668    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/196f85b0-a352-4c0a-8591-5fd20046d8d9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.708828 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.708811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/196f85b0-a352-4c0a-8591-5fd20046d8d9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.718000 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.717973    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/196f85b0-a352-4c0a-8591-5fd20046d8d9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.718198 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.718180    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbxkn\" (UniqueName: \"kubernetes.io/projected/196f85b0-a352-4c0a-8591-5fd20046d8d9-kube-api-access-fbxkn\") pod \"maas-default-gateway-openshift-default-56654dcf7-wfrg7\" (UID: \"196f85b0-a352-4c0a-8591-5fd20046d8d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.757180 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.757096    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:50.787711 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.787677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:50.924053 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:50.924029    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"]
Jul 10 21:28:50.925755 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:28:50.925732    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196f85b0_a352_4c0a_8591_5fd20046d8d9.slice/crio-ece36332202a19e511ce1e66b124e67b587e5f57a37edfd7948ee60559575349 WatchSource:0}: Error finding container ece36332202a19e511ce1e66b124e67b587e5f57a37edfd7948ee60559575349: Status 404 returned error can't find the container with id ece36332202a19e511ce1e66b124e67b587e5f57a37edfd7948ee60559575349
Jul 10 21:28:51.652366 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:51.652316    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7" event={"ID":"196f85b0-a352-4c0a-8591-5fd20046d8d9","Type":"ContainerStarted","Data":"ece36332202a19e511ce1e66b124e67b587e5f57a37edfd7948ee60559575349"}
Jul 10 21:28:53.252701 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:53.252660    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:28:53.252975 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:53.252736    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:28:53.252975 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:53.252768    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:28:53.664708 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:53.664660    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7" event={"ID":"196f85b0-a352-4c0a-8591-5fd20046d8d9","Type":"ContainerStarted","Data":"b23d607aa8c7b35cf9b9d660fd49db08805c431dd1239156af0b973e108b33dd"}
Jul 10 21:28:53.687500 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:53.687446    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7" podStartSLOduration=1.362999256 podStartE2EDuration="3.687431068s" totalImagesPullingTime="2.324431812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:28:53.686436667 +0000 UTC m=+459.319681920" watchObservedRunningTime="2026-07-10 21:28:53.687431068 +0000 UTC m=+459.320676322"
Jul 10 21:28:53.788728 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:53.788690    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:54.708905 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.708865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:54.710200 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.710178    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"]
Jul 10 21:28:54.712600 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.712582    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"
Jul 10 21:28:54.715143 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.715123    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 21:28:54.715254 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.715148    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4k5w9\""
Jul 10 21:28:54.721397 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.721376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"]
Jul 10 21:28:54.793532 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.793503    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:54.797404 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.797372    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"]
Jul 10 21:28:54.799235 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.799209    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:54.842436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.842401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpmz\" (UniqueName: \"kubernetes.io/projected/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4-kube-api-access-fbpmz\") pod \"limitador-limitador-64c94fd64f-n5rfl\" (UID: \"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"
Jul 10 21:28:54.842599 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.842445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4-config-file\") pod \"limitador-limitador-64c94fd64f-n5rfl\" (UID: \"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"
Jul 10 21:28:54.873756 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.873677    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:54.943030 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.942993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpmz\" (UniqueName: \"kubernetes.io/projected/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4-kube-api-access-fbpmz\") pod \"limitador-limitador-64c94fd64f-n5rfl\" (UID: \"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"
Jul 10 21:28:54.943213 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.943035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4-config-file\") pod \"limitador-limitador-64c94fd64f-n5rfl\" (UID: \"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"
Jul 10 21:28:54.943742 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.943724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4-config-file\") pod \"limitador-limitador-64c94fd64f-n5rfl\" (UID: \"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"
Jul 10 21:28:54.952571 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:54.952545    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpmz\" (UniqueName: \"kubernetes.io/projected/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4-kube-api-access-fbpmz\") pod \"limitador-limitador-64c94fd64f-n5rfl\" (UID: \"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"
Jul 10 21:28:55.023843 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.023790    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"
Jul 10 21:28:55.123831 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.123744    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:28:55.127341 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.127315    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59"
Jul 10 21:28:55.136449 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.136414    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:28:55.168494 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.168468    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"]
Jul 10 21:28:55.170414 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:28:55.170390    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7e9cc6_192e_4a5b_9718_9f1fedd33af4.slice/crio-40aa6a67633d0aba14586c30806bead7b6b5ed5b4ddcc3a140403fcf24c80117 WatchSource:0}: Error finding container 40aa6a67633d0aba14586c30806bead7b6b5ed5b4ddcc3a140403fcf24c80117: Status 404 returned error can't find the container with id 40aa6a67633d0aba14586c30806bead7b6b5ed5b4ddcc3a140403fcf24c80117
Jul 10 21:28:55.179688 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.179665    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:28:55.245698 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.245659    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9ddz\" (UniqueName: \"kubernetes.io/projected/12b586e1-b503-4c5d-9eed-572197941bc3-kube-api-access-f9ddz\") pod \"limitador-limitador-54d6d988d5-jzc59\" (UID: \"12b586e1-b503-4c5d-9eed-572197941bc3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59"
Jul 10 21:28:55.245874 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.245736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12b586e1-b503-4c5d-9eed-572197941bc3-config-file\") pod \"limitador-limitador-54d6d988d5-jzc59\" (UID: \"12b586e1-b503-4c5d-9eed-572197941bc3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59"
Jul 10 21:28:55.347158 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.347103    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9ddz\" (UniqueName: \"kubernetes.io/projected/12b586e1-b503-4c5d-9eed-572197941bc3-kube-api-access-f9ddz\") pod \"limitador-limitador-54d6d988d5-jzc59\" (UID: \"12b586e1-b503-4c5d-9eed-572197941bc3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59"
Jul 10 21:28:55.347363 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.347178    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12b586e1-b503-4c5d-9eed-572197941bc3-config-file\") pod \"limitador-limitador-54d6d988d5-jzc59\" (UID: \"12b586e1-b503-4c5d-9eed-572197941bc3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59"
Jul 10 21:28:55.347793 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.347772    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12b586e1-b503-4c5d-9eed-572197941bc3-config-file\") pod \"limitador-limitador-54d6d988d5-jzc59\" (UID: \"12b586e1-b503-4c5d-9eed-572197941bc3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59"
Jul 10 21:28:55.356170 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.356138    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9ddz\" (UniqueName: \"kubernetes.io/projected/12b586e1-b503-4c5d-9eed-572197941bc3-kube-api-access-f9ddz\") pod \"limitador-limitador-54d6d988d5-jzc59\" (UID: \"12b586e1-b503-4c5d-9eed-572197941bc3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59"
Jul 10 21:28:55.440112 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.440021    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59"
Jul 10 21:28:55.581369 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.581333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:55.603645 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.603611    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:28:55.606578 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:28:55.606556    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b586e1_b503_4c5d_9eed_572197941bc3.slice/crio-58c01f8ed77502e4434c19bf1bea2a8e10f741dcd240ec9dfe699b3772bd0749 WatchSource:0}: Error finding container 58c01f8ed77502e4434c19bf1bea2a8e10f741dcd240ec9dfe699b3772bd0749: Status 404 returned error can't find the container with id 58c01f8ed77502e4434c19bf1bea2a8e10f741dcd240ec9dfe699b3772bd0749
Jul 10 21:28:55.675731 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.675693    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl" event={"ID":"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4","Type":"ContainerStarted","Data":"40aa6a67633d0aba14586c30806bead7b6b5ed5b4ddcc3a140403fcf24c80117"}
Jul 10 21:28:55.676722 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.676698    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59" event={"ID":"12b586e1-b503-4c5d-9eed-572197941bc3","Type":"ContainerStarted","Data":"58c01f8ed77502e4434c19bf1bea2a8e10f741dcd240ec9dfe699b3772bd0749"}
Jul 10 21:28:55.676891 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.676878    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:55.677853 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.677836    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:28:55.682849 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:55.682827    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:28:58.695492 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:58.695457    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl" event={"ID":"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4","Type":"ContainerStarted","Data":"652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728"}
Jul 10 21:28:58.695985 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:58.695514    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"
Jul 10 21:28:58.697055 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:58.697031    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59" event={"ID":"12b586e1-b503-4c5d-9eed-572197941bc3","Type":"ContainerStarted","Data":"6e3b72683f33f209be5b330b41097c68925537f3ad53687cb3f4a60f10da93e5"}
Jul 10 21:28:58.697159 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:58.697085    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59"
Jul 10 21:28:58.722529 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:58.722485    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl" podStartSLOduration=1.576265308 podStartE2EDuration="4.722468899s" totalImagesPullingTime="3.146203591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:28:58.72107077 +0000 UTC m=+464.354316024" watchObservedRunningTime="2026-07-10 21:28:58.722468899 +0000 UTC m=+464.355714181"
Jul 10 21:28:58.761553 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:28:58.761500    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59" podStartSLOduration=1.044712751 podStartE2EDuration="3.761483383s" totalImagesPullingTime="2.716770632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:28:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:28:58.759907338 +0000 UTC m=+464.393152592" watchObservedRunningTime="2026-07-10 21:28:58.761483383 +0000 UTC m=+464.394728637"
Jul 10 21:29:09.702998 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:09.702968    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jzc59"
Jul 10 21:29:09.703461 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:09.703037    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"
Jul 10 21:29:09.761528 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:09.761489    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"]
Jul 10 21:29:09.761735 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:09.761706    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl" podUID="9a7e9cc6-192e-4a5b-9718-9f1fedd33af4" containerName="limitador" containerID="cri-o://652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728" gracePeriod=30
Jul 10 21:29:10.314700 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.314674    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"
Jul 10 21:29:10.381496 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.381464    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4-config-file\") pod \"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4\" (UID: \"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4\") "
Jul 10 21:29:10.381694 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.381516    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbpmz\" (UniqueName: \"kubernetes.io/projected/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4-kube-api-access-fbpmz\") pod \"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4\" (UID: \"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4\") "
Jul 10 21:29:10.381835 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.381807    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4-config-file" (OuterVolumeSpecName: "config-file") pod "9a7e9cc6-192e-4a5b-9718-9f1fedd33af4" (UID: "9a7e9cc6-192e-4a5b-9718-9f1fedd33af4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:29:10.383585 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.383556    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4-kube-api-access-fbpmz" (OuterVolumeSpecName: "kube-api-access-fbpmz") pod "9a7e9cc6-192e-4a5b-9718-9f1fedd33af4" (UID: "9a7e9cc6-192e-4a5b-9718-9f1fedd33af4"). InnerVolumeSpecName "kube-api-access-fbpmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:29:10.482452 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.482415    2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4-config-file\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:29:10.482452 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.482455    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbpmz\" (UniqueName: \"kubernetes.io/projected/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4-kube-api-access-fbpmz\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:29:10.759080 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.758994    2575 generic.go:356] "Generic (PLEG): container finished" podID="9a7e9cc6-192e-4a5b-9718-9f1fedd33af4" containerID="652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728" exitCode=0
Jul 10 21:29:10.759080 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.759043    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl" event={"ID":"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4","Type":"ContainerDied","Data":"652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728"}
Jul 10 21:29:10.759080 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.759066    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"
Jul 10 21:29:10.759080 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.759084    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5rfl" event={"ID":"9a7e9cc6-192e-4a5b-9718-9f1fedd33af4","Type":"ContainerDied","Data":"40aa6a67633d0aba14586c30806bead7b6b5ed5b4ddcc3a140403fcf24c80117"}
Jul 10 21:29:10.759635 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.759106    2575 scope.go:117] "RemoveContainer" containerID="652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728"
Jul 10 21:29:10.768160 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.767951    2575 scope.go:117] "RemoveContainer" containerID="652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728"
Jul 10 21:29:10.768355 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:29:10.768333    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728\": container with ID starting with 652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728 not found: ID does not exist" containerID="652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728"
Jul 10 21:29:10.768418 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.768364    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728"} err="failed to get container status \"652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728\": rpc error: code = NotFound desc = could not find container \"652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728\": container with ID starting with 652f0d1cb675c3dc2f187df518f3c4f3116bd16b718db65416137d2d1a5d6728 not found: ID does not exist"
Jul 10 21:29:10.790135 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.790100    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"]
Jul 10 21:29:10.804573 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.804539    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5rfl"]
Jul 10 21:29:10.833711 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.833671    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:10.929223 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:10.929189    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:11.315047 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:11.315015    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:11.522806 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:11.522772    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a7e9cc6-192e-4a5b-9718-9f1fedd33af4" path="/var/lib/kubelet/pods/9a7e9cc6-192e-4a5b-9718-9f1fedd33af4/volumes"
Jul 10 21:29:21.104892 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:21.104858    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:23.889768 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:23.889739    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:24.281673 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:24.281577    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:25.380667 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:25.380627    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:25.493982 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:25.493942    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:30.141444 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.141410    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:30.243993 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.243962    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:30.318997 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.318955    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:30.589816 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.589779    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d675976db-x55xm"]
Jul 10 21:29:30.590302 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.590264    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a7e9cc6-192e-4a5b-9718-9f1fedd33af4" containerName="limitador"
Jul 10 21:29:30.590302 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.590300    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a7e9cc6-192e-4a5b-9718-9f1fedd33af4" containerName="limitador"
Jul 10 21:29:30.590513 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.590380    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a7e9cc6-192e-4a5b-9718-9f1fedd33af4" containerName="limitador"
Jul 10 21:29:30.601351 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.601318    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d675976db-x55xm"
Jul 10 21:29:30.604231 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.604196    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-trxx4\""
Jul 10 21:29:30.604231 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.604226    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d675976db-x55xm"]
Jul 10 21:29:30.604482 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.604233    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 21:29:30.605005 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.604987    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 21:29:30.759583 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.759550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45d2277a-03d7-4ad2-919d-aa234cb90d3b-webhook-cert\") pod \"maas-controller-6d675976db-x55xm\" (UID: \"45d2277a-03d7-4ad2-919d-aa234cb90d3b\") " pod="opendatahub/maas-controller-6d675976db-x55xm"
Jul 10 21:29:30.759583 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.759594    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9clw\" (UniqueName: \"kubernetes.io/projected/45d2277a-03d7-4ad2-919d-aa234cb90d3b-kube-api-access-z9clw\") pod \"maas-controller-6d675976db-x55xm\" (UID: \"45d2277a-03d7-4ad2-919d-aa234cb90d3b\") " pod="opendatahub/maas-controller-6d675976db-x55xm"
Jul 10 21:29:30.793199 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.793163    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:30.860560 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.860478    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45d2277a-03d7-4ad2-919d-aa234cb90d3b-webhook-cert\") pod \"maas-controller-6d675976db-x55xm\" (UID: \"45d2277a-03d7-4ad2-919d-aa234cb90d3b\") " pod="opendatahub/maas-controller-6d675976db-x55xm"
Jul 10 21:29:30.860560 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.860516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9clw\" (UniqueName: \"kubernetes.io/projected/45d2277a-03d7-4ad2-919d-aa234cb90d3b-kube-api-access-z9clw\") pod \"maas-controller-6d675976db-x55xm\" (UID: \"45d2277a-03d7-4ad2-919d-aa234cb90d3b\") " pod="opendatahub/maas-controller-6d675976db-x55xm"
Jul 10 21:29:30.862984 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.862956    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45d2277a-03d7-4ad2-919d-aa234cb90d3b-webhook-cert\") pod \"maas-controller-6d675976db-x55xm\" (UID: \"45d2277a-03d7-4ad2-919d-aa234cb90d3b\") " pod="opendatahub/maas-controller-6d675976db-x55xm"
Jul 10 21:29:30.870032 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.870009    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9clw\" (UniqueName: \"kubernetes.io/projected/45d2277a-03d7-4ad2-919d-aa234cb90d3b-kube-api-access-z9clw\") pod \"maas-controller-6d675976db-x55xm\" (UID: \"45d2277a-03d7-4ad2-919d-aa234cb90d3b\") " pod="opendatahub/maas-controller-6d675976db-x55xm"
Jul 10 21:29:30.913872 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:30.913842    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d675976db-x55xm"
Jul 10 21:29:31.056264 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:31.056237    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d675976db-x55xm"]
Jul 10 21:29:31.058180 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:29:31.058149    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d2277a_03d7_4ad2_919d_aa234cb90d3b.slice/crio-8a231c8b2ae813c3a6700538eaada00b544ccc21e6ad156db422f92a18854248 WatchSource:0}: Error finding container 8a231c8b2ae813c3a6700538eaada00b544ccc21e6ad156db422f92a18854248: Status 404 returned error can't find the container with id 8a231c8b2ae813c3a6700538eaada00b544ccc21e6ad156db422f92a18854248
Jul 10 21:29:31.866545 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:31.866501    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d675976db-x55xm" event={"ID":"45d2277a-03d7-4ad2-919d-aa234cb90d3b","Type":"ContainerStarted","Data":"8a231c8b2ae813c3a6700538eaada00b544ccc21e6ad156db422f92a18854248"}
Jul 10 21:29:33.204914 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:33.204883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:33.302167 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:33.302076    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:33.878170 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:33.878132    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d675976db-x55xm" event={"ID":"45d2277a-03d7-4ad2-919d-aa234cb90d3b","Type":"ContainerStarted","Data":"f4336139950c5900b27931893a2ded98a16208f79e64af51cda3bee2d64e04f7"}
Jul 10 21:29:33.878408 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:33.878305    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d675976db-x55xm"
Jul 10 21:29:33.910073 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:33.910017    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d675976db-x55xm" podStartSLOduration=2.011147794 podStartE2EDuration="3.9100025s" totalImagesPullingTime="1.898854706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:29:33.90909602 +0000 UTC m=+499.542341273" watchObservedRunningTime="2026-07-10 21:29:33.9100025 +0000 UTC m=+499.543247754"
Jul 10 21:29:37.834396 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:37.834365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:37.905415 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:37.905383    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:44.885428 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:44.885398    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d675976db-x55xm"
Jul 10 21:29:51.407625 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:51.407590    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:29:51.508758 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:29:51.508721    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:07.296505 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.296433    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:07.498833 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.498798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:07.783975 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.783938    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:07.838133 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.838092    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"]
Jul 10 21:30:07.841960 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.841935    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:07.846531 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.846507    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 21:30:07.846706 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.846505    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 10 21:30:07.846706 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.846562    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 21:30:07.856185 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.856152    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"]
Jul 10 21:30:07.942484 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.942452    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:07.954633 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.954598    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbj9p\" (UniqueName: \"kubernetes.io/projected/7bc05283-cb04-419a-9e03-bc44145cde14-kube-api-access-vbj9p\") pod \"maas-api-9c64f46fb-4fzjw\" (UID: \"7bc05283-cb04-419a-9e03-bc44145cde14\") " pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:07.954822 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.954654    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bc05283-cb04-419a-9e03-bc44145cde14-maas-api-tls\") pod \"maas-api-9c64f46fb-4fzjw\" (UID: \"7bc05283-cb04-419a-9e03-bc44145cde14\") " pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:07.954822 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:07.954731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bc05283-cb04-419a-9e03-bc44145cde14-openshift-service-ca\") pod \"maas-api-9c64f46fb-4fzjw\" (UID: \"7bc05283-cb04-419a-9e03-bc44145cde14\") " pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:08.055765 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.055677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbj9p\" (UniqueName: \"kubernetes.io/projected/7bc05283-cb04-419a-9e03-bc44145cde14-kube-api-access-vbj9p\") pod \"maas-api-9c64f46fb-4fzjw\" (UID: \"7bc05283-cb04-419a-9e03-bc44145cde14\") " pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:08.055765 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.055723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bc05283-cb04-419a-9e03-bc44145cde14-maas-api-tls\") pod \"maas-api-9c64f46fb-4fzjw\" (UID: \"7bc05283-cb04-419a-9e03-bc44145cde14\") " pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:08.055994 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.055914    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bc05283-cb04-419a-9e03-bc44145cde14-openshift-service-ca\") pod \"maas-api-9c64f46fb-4fzjw\" (UID: \"7bc05283-cb04-419a-9e03-bc44145cde14\") " pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:08.056558 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.056539    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bc05283-cb04-419a-9e03-bc44145cde14-openshift-service-ca\") pod \"maas-api-9c64f46fb-4fzjw\" (UID: \"7bc05283-cb04-419a-9e03-bc44145cde14\") " pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:08.058198 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.058179    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bc05283-cb04-419a-9e03-bc44145cde14-maas-api-tls\") pod \"maas-api-9c64f46fb-4fzjw\" (UID: \"7bc05283-cb04-419a-9e03-bc44145cde14\") " pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:08.065466 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.065436    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbj9p\" (UniqueName: \"kubernetes.io/projected/7bc05283-cb04-419a-9e03-bc44145cde14-kube-api-access-vbj9p\") pod \"maas-api-9c64f46fb-4fzjw\" (UID: \"7bc05283-cb04-419a-9e03-bc44145cde14\") " pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:08.153220 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.153164    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:08.301853 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.301771    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"]
Jul 10 21:30:08.306259 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:30:08.306180    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc05283_cb04_419a_9e03_bc44145cde14.slice/crio-dd2a9699c7a87fd1a26b40bc853c08eeb941b8ba236fc49e57f409f19b5c73f5 WatchSource:0}: Error finding container dd2a9699c7a87fd1a26b40bc853c08eeb941b8ba236fc49e57f409f19b5c73f5: Status 404 returned error can't find the container with id dd2a9699c7a87fd1a26b40bc853c08eeb941b8ba236fc49e57f409f19b5c73f5
Jul 10 21:30:08.633986 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.633942    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:08.743263 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.743227    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:08.903493 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.903409    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"]
Jul 10 21:30:08.908315 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.908264    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"
Jul 10 21:30:08.914503 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.914478    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7d47m\""
Jul 10 21:30:08.914672 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.914478    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 10 21:30:08.927864 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.927838    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"]
Jul 10 21:30:08.963235 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.963200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f26fd12-63b6-478c-b1e5-097e8f37d2f9-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-dx4dh\" (UID: \"8f26fd12-63b6-478c-b1e5-097e8f37d2f9\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"
Jul 10 21:30:08.963433 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.963311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mprm\" (UniqueName: \"kubernetes.io/projected/8f26fd12-63b6-478c-b1e5-097e8f37d2f9-kube-api-access-7mprm\") pod \"payload-processing-f9b8d9b9b-dx4dh\" (UID: \"8f26fd12-63b6-478c-b1e5-097e8f37d2f9\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"
Jul 10 21:30:08.978564 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:08.978533    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:30:09.054038 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:09.053997    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw" event={"ID":"7bc05283-cb04-419a-9e03-bc44145cde14","Type":"ContainerStarted","Data":"dd2a9699c7a87fd1a26b40bc853c08eeb941b8ba236fc49e57f409f19b5c73f5"}
Jul 10 21:30:09.064489 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:09.064446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f26fd12-63b6-478c-b1e5-097e8f37d2f9-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-dx4dh\" (UID: \"8f26fd12-63b6-478c-b1e5-097e8f37d2f9\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"
Jul 10 21:30:09.064666 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:09.064579    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mprm\" (UniqueName: \"kubernetes.io/projected/8f26fd12-63b6-478c-b1e5-097e8f37d2f9-kube-api-access-7mprm\") pod \"payload-processing-f9b8d9b9b-dx4dh\" (UID: \"8f26fd12-63b6-478c-b1e5-097e8f37d2f9\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"
Jul 10 21:30:09.065512 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:09.065464    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f26fd12-63b6-478c-b1e5-097e8f37d2f9-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-dx4dh\" (UID: \"8f26fd12-63b6-478c-b1e5-097e8f37d2f9\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"
Jul 10 21:30:09.085781 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:09.085741    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mprm\" (UniqueName: \"kubernetes.io/projected/8f26fd12-63b6-478c-b1e5-097e8f37d2f9-kube-api-access-7mprm\") pod \"payload-processing-f9b8d9b9b-dx4dh\" (UID: \"8f26fd12-63b6-478c-b1e5-097e8f37d2f9\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"
Jul 10 21:30:09.219405 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:09.219305    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"
Jul 10 21:30:09.371115 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:09.371086    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"]
Jul 10 21:30:09.372926 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:30:09.372901    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f26fd12_63b6_478c_b1e5_097e8f37d2f9.slice/crio-7ef69bbfe8a17654d0ccbbfe44834baa8081a937a1d67f6c20239cf6b4f7d01c WatchSource:0}: Error finding container 7ef69bbfe8a17654d0ccbbfe44834baa8081a937a1d67f6c20239cf6b4f7d01c: Status 404 returned error can't find the container with id 7ef69bbfe8a17654d0ccbbfe44834baa8081a937a1d67f6c20239cf6b4f7d01c
Jul 10 21:30:10.069720 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:10.069686    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh" event={"ID":"8f26fd12-63b6-478c-b1e5-097e8f37d2f9","Type":"ContainerStarted","Data":"7ef69bbfe8a17654d0ccbbfe44834baa8081a937a1d67f6c20239cf6b4f7d01c"}
Jul 10 21:30:11.076970 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:11.076936    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw" event={"ID":"7bc05283-cb04-419a-9e03-bc44145cde14","Type":"ContainerStarted","Data":"28135847db599d063ddb356ad1e674142f972559e92224a95799f44cbd123619"}
Jul 10 21:30:11.077482 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:11.077096    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:11.097105 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:11.097056    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw" podStartSLOduration=1.997756017 podStartE2EDuration="4.09704092s" totalImagesPullingTime="2.099284903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:30:11.095021988 +0000 UTC m=+536.728267243" watchObservedRunningTime="2026-07-10 21:30:11.09704092 +0000 UTC m=+536.730286173"
Jul 10 21:30:12.084357 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:12.084306    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh" event={"ID":"8f26fd12-63b6-478c-b1e5-097e8f37d2f9","Type":"ContainerStarted","Data":"1cfb75a6aa345b79f5ef439fe0c7ff4478545326fc515ef9087ecf604d46ed09"}
Jul 10 21:30:12.084822 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:12.084459    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"
Jul 10 21:30:12.108995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:12.108934    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh" podStartSLOduration=2.159801034 podStartE2EDuration="4.108915859s" totalImagesPullingTime="1.949114825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:30:12.108041529 +0000 UTC m=+537.741286782" watchObservedRunningTime="2026-07-10 21:30:12.108915859 +0000 UTC m=+537.742161116"
Jul 10 21:30:17.089978 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:17.089947    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-9c64f46fb-4fzjw"
Jul 10 21:30:17.112083 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:17.112049    2575 generic.go:356] "Generic (PLEG): container finished" podID="196f85b0-a352-4c0a-8591-5fd20046d8d9" containerID="b23d607aa8c7b35cf9b9d660fd49db08805c431dd1239156af0b973e108b33dd" exitCode=0
Jul 10 21:30:17.112249 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:17.112124    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7" event={"ID":"196f85b0-a352-4c0a-8591-5fd20046d8d9","Type":"ContainerDied","Data":"b23d607aa8c7b35cf9b9d660fd49db08805c431dd1239156af0b973e108b33dd"}
Jul 10 21:30:17.112551 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:17.112535    2575 scope.go:117] "RemoveContainer" containerID="b23d607aa8c7b35cf9b9d660fd49db08805c431dd1239156af0b973e108b33dd"
Jul 10 21:30:17.113545 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:17.113519    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:30:17.113608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:17.113586    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:30:17.113647 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:17.113633    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:30:18.120708 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:18.120673    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7" event={"ID":"196f85b0-a352-4c0a-8591-5fd20046d8d9","Type":"ContainerStarted","Data":"cabdf37ba0568606ab9b20e8f004738708b07af4d8a41e22a6548a3af5f3f9e3"}
Jul 10 21:30:18.149530 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:18.149494    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:18.248167 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:18.248136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:18.788232 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:18.788193    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:30:18.788436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:18.788398    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wfrg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 10 21:30:18.788492 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:18.788442    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7" podUID="196f85b0-a352-4c0a-8591-5fd20046d8d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 10 21:30:19.788121 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:19.788078    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wfrg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 10 21:30:19.788553 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:19.788142    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7" podUID="196f85b0-a352-4c0a-8591-5fd20046d8d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 10 21:30:20.789053 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:20.789011    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wfrg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 10 21:30:20.789496 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:20.789064    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7" podUID="196f85b0-a352-4c0a-8591-5fd20046d8d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 10 21:30:21.788839 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:21.788796    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wfrg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 10 21:30:21.789055 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:21.788864    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7" podUID="196f85b0-a352-4c0a-8591-5fd20046d8d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 10 21:30:22.831106 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:22.831071    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:30:22.831578 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:22.831490    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:30:22.832415 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:22.832396    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wfrg7"
Jul 10 21:30:23.092923 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:23.092838    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-dx4dh"
Jul 10 21:30:28.957820 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:28.957786    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:29.498390 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:29.498348    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:30:34.720329 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:34.720249    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:34.807082 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:34.807042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:34.913196 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:34.913159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:35.739673 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:35.739628    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:30:45.500587 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.500551    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"]
Jul 10 21:30:45.504623 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.504601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.507447 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.507422    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-crb2j\""
Jul 10 21:30:45.508367 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.508332    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 10 21:30:45.508480 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.508389    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 21:30:45.508480 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.508401    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 21:30:45.523320 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.523248    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"]
Jul 10 21:30:45.536008 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.535976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:45.570718 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.570683    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faf2be32-3c61-47e3-9803-1470b012f701-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.570718 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.570723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgznh\" (UniqueName: \"kubernetes.io/projected/faf2be32-3c61-47e3-9803-1470b012f701-kube-api-access-zgznh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.570980 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.570754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faf2be32-3c61-47e3-9803-1470b012f701-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.570980 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.570844    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faf2be32-3c61-47e3-9803-1470b012f701-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.570980 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.570881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faf2be32-3c61-47e3-9803-1470b012f701-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.570980 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.570950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faf2be32-3c61-47e3-9803-1470b012f701-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.671893 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.671852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faf2be32-3c61-47e3-9803-1470b012f701-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.671893 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.671908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faf2be32-3c61-47e3-9803-1470b012f701-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.672169 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.671932    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faf2be32-3c61-47e3-9803-1470b012f701-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.672169 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.671969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faf2be32-3c61-47e3-9803-1470b012f701-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.672169 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.672042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faf2be32-3c61-47e3-9803-1470b012f701-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.672169 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.672072    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgznh\" (UniqueName: \"kubernetes.io/projected/faf2be32-3c61-47e3-9803-1470b012f701-kube-api-access-zgznh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.672499 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.672448    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faf2be32-3c61-47e3-9803-1470b012f701-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.672499 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.672473    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faf2be32-3c61-47e3-9803-1470b012f701-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.672648 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.672541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faf2be32-3c61-47e3-9803-1470b012f701-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.674556 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.674533    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faf2be32-3c61-47e3-9803-1470b012f701-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.674733 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.674714    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faf2be32-3c61-47e3-9803-1470b012f701-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.684709 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.684682    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgznh\" (UniqueName: \"kubernetes.io/projected/faf2be32-3c61-47e3-9803-1470b012f701-kube-api-access-zgznh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tsdqc\" (UID: \"faf2be32-3c61-47e3-9803-1470b012f701\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.814997 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.814893    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:45.961461 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:45.961432    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"]
Jul 10 21:30:45.963804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:30:45.963768    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf2be32_3c61_47e3_9803_1470b012f701.slice/crio-419642afb4b41e8920584f8f792f2958327c054be912ff9f61e8b5af268925fd WatchSource:0}: Error finding container 419642afb4b41e8920584f8f792f2958327c054be912ff9f61e8b5af268925fd: Status 404 returned error can't find the container with id 419642afb4b41e8920584f8f792f2958327c054be912ff9f61e8b5af268925fd
Jul 10 21:30:46.272045 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:46.271978    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc" event={"ID":"faf2be32-3c61-47e3-9803-1470b012f701","Type":"ContainerStarted","Data":"419642afb4b41e8920584f8f792f2958327c054be912ff9f61e8b5af268925fd"}
Jul 10 21:30:46.713568 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:46.713525    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:30:47.280312 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:47.280183    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc" event={"ID":"faf2be32-3c61-47e3-9803-1470b012f701","Type":"ContainerStarted","Data":"9a6961dd80399049622dfab90631bf183be3e282d520b425df7e26d6184ca442"}
Jul 10 21:30:52.138474 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:52.138421    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:30:53.800067 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:53.800003    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc" podStartSLOduration=7.753678097 podStartE2EDuration="8.799985173s" totalImagesPullingTime="1.046307076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:30:47.348371687 +0000 UTC m=+572.981616941" watchObservedRunningTime="2026-07-10 21:30:53.799985173 +0000 UTC m=+579.433230427"
Jul 10 21:30:53.802331 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:53.802303    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:30:55.815083 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:55.815045    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:55.815517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:55.815114    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:55.827421 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:55.827396    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:56.338237 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:56.338211    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tsdqc"
Jul 10 21:30:59.730133 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:30:59.730097    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:31:01.846617 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:01.846583    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:31:03.407304 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.407259    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"]
Jul 10 21:31:03.411102 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.411082    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.414243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.414222    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 10 21:31:03.421878 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.421857    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"]
Jul 10 21:31:03.532832 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.532795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f267c\" (UniqueName: \"kubernetes.io/projected/ab584d2f-02d3-43e2-859a-daf7fe55449c-kube-api-access-f267c\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.533035 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.532839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab584d2f-02d3-43e2-859a-daf7fe55449c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.533035 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.532875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab584d2f-02d3-43e2-859a-daf7fe55449c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.533035 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.532901    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab584d2f-02d3-43e2-859a-daf7fe55449c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.533035 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.532918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab584d2f-02d3-43e2-859a-daf7fe55449c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.533035 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.532967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab584d2f-02d3-43e2-859a-daf7fe55449c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.634078 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.634036    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f267c\" (UniqueName: \"kubernetes.io/projected/ab584d2f-02d3-43e2-859a-daf7fe55449c-kube-api-access-f267c\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.634302 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.634092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab584d2f-02d3-43e2-859a-daf7fe55449c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.634302 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.634118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab584d2f-02d3-43e2-859a-daf7fe55449c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.634302 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.634147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab584d2f-02d3-43e2-859a-daf7fe55449c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.634302 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.634172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab584d2f-02d3-43e2-859a-daf7fe55449c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.634302 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.634205    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab584d2f-02d3-43e2-859a-daf7fe55449c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.634679 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.634640    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab584d2f-02d3-43e2-859a-daf7fe55449c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.634787 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.634736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab584d2f-02d3-43e2-859a-daf7fe55449c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.634872 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.634851    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab584d2f-02d3-43e2-859a-daf7fe55449c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.636570 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.636541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab584d2f-02d3-43e2-859a-daf7fe55449c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.636847 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.636826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab584d2f-02d3-43e2-859a-daf7fe55449c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.657587 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.657523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f267c\" (UniqueName: \"kubernetes.io/projected/ab584d2f-02d3-43e2-859a-daf7fe55449c-kube-api-access-f267c\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp\" (UID: \"ab584d2f-02d3-43e2-859a-daf7fe55449c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.720080 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.720050    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:03.865608 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.865582    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"]
Jul 10 21:31:03.867173 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:31:03.867146    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab584d2f_02d3_43e2_859a_daf7fe55449c.slice/crio-89428e0e2dce670de33ea89cece6ad56c4abb9d22ed2c43f9dc95877f433b8ee WatchSource:0}: Error finding container 89428e0e2dce670de33ea89cece6ad56c4abb9d22ed2c43f9dc95877f433b8ee: Status 404 returned error can't find the container with id 89428e0e2dce670de33ea89cece6ad56c4abb9d22ed2c43f9dc95877f433b8ee
Jul 10 21:31:03.911645 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:03.911558    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:31:04.028590 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:04.028553    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:31:04.367335 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:04.367294    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp" event={"ID":"ab584d2f-02d3-43e2-859a-daf7fe55449c","Type":"ContainerStarted","Data":"f2fe0c20c416f1219f0dbed2bd6d2a40b580d63a08af71d28d446395a405df12"}
Jul 10 21:31:04.367335 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:04.367337    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp" event={"ID":"ab584d2f-02d3-43e2-859a-daf7fe55449c","Type":"ContainerStarted","Data":"89428e0e2dce670de33ea89cece6ad56c4abb9d22ed2c43f9dc95877f433b8ee"}
Jul 10 21:31:04.393560 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:04.393504    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp" podStartSLOduration=1.234629258 podStartE2EDuration="1.393487627s" totalImagesPullingTime="158.858369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:31:04.391140791 +0000 UTC m=+590.024386049" watchObservedRunningTime="2026-07-10 21:31:04.393487627 +0000 UTC m=+590.026732872"
Jul 10 21:31:12.808655 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:12.808619    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:31:13.720684 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:13.720647    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:13.720832 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:13.720701    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:13.733896 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:13.733870    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:14.437326 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:14.437268    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp"
Jul 10 21:31:15.445233 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:15.445205    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:31:15.445995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:15.445975    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:31:36.624243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:36.624169    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:31:36.715327 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:36.715265    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:31:37.865559 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:37.865523    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:31:38.000895 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:31:38.000862    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:32:06.217802 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:06.217757    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:32:15.614149 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:15.614111    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:32:26.053016 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:26.052951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:32:26.129627 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:26.129597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:32:27.396490 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:27.396452    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:32:35.598448 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:35.598419    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:32:47.394570 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:47.394535    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:32:48.609239 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:48.609178    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:32:48.698918 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:48.698867    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d675976db-x55xm"]
Jul 10 21:32:48.699192 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:48.699142    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6d675976db-x55xm" podUID="45d2277a-03d7-4ad2-919d-aa234cb90d3b" containerName="manager" containerID="cri-o://f4336139950c5900b27931893a2ded98a16208f79e64af51cda3bee2d64e04f7" gracePeriod=30
Jul 10 21:32:48.916936 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:48.916900    2575 generic.go:356] "Generic (PLEG): container finished" podID="45d2277a-03d7-4ad2-919d-aa234cb90d3b" containerID="f4336139950c5900b27931893a2ded98a16208f79e64af51cda3bee2d64e04f7" exitCode=0
Jul 10 21:32:48.917148 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:48.916977    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d675976db-x55xm" event={"ID":"45d2277a-03d7-4ad2-919d-aa234cb90d3b","Type":"ContainerDied","Data":"f4336139950c5900b27931893a2ded98a16208f79e64af51cda3bee2d64e04f7"}
Jul 10 21:32:48.951896 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:48.951869    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d675976db-x55xm"
Jul 10 21:32:49.072853 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:49.072816    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9clw\" (UniqueName: \"kubernetes.io/projected/45d2277a-03d7-4ad2-919d-aa234cb90d3b-kube-api-access-z9clw\") pod \"45d2277a-03d7-4ad2-919d-aa234cb90d3b\" (UID: \"45d2277a-03d7-4ad2-919d-aa234cb90d3b\") "
Jul 10 21:32:49.073055 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:49.072884    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45d2277a-03d7-4ad2-919d-aa234cb90d3b-webhook-cert\") pod \"45d2277a-03d7-4ad2-919d-aa234cb90d3b\" (UID: \"45d2277a-03d7-4ad2-919d-aa234cb90d3b\") "
Jul 10 21:32:49.075037 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:49.075008    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d2277a-03d7-4ad2-919d-aa234cb90d3b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "45d2277a-03d7-4ad2-919d-aa234cb90d3b" (UID: "45d2277a-03d7-4ad2-919d-aa234cb90d3b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:32:49.075224 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:49.075193    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d2277a-03d7-4ad2-919d-aa234cb90d3b-kube-api-access-z9clw" (OuterVolumeSpecName: "kube-api-access-z9clw") pod "45d2277a-03d7-4ad2-919d-aa234cb90d3b" (UID: "45d2277a-03d7-4ad2-919d-aa234cb90d3b"). InnerVolumeSpecName "kube-api-access-z9clw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:32:49.174213 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:49.174113    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9clw\" (UniqueName: \"kubernetes.io/projected/45d2277a-03d7-4ad2-919d-aa234cb90d3b-kube-api-access-z9clw\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:32:49.174213 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:49.174150    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45d2277a-03d7-4ad2-919d-aa234cb90d3b-webhook-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:32:49.923330 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:49.923303    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d675976db-x55xm"
Jul 10 21:32:49.923761 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:49.923303    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d675976db-x55xm" event={"ID":"45d2277a-03d7-4ad2-919d-aa234cb90d3b","Type":"ContainerDied","Data":"8a231c8b2ae813c3a6700538eaada00b544ccc21e6ad156db422f92a18854248"}
Jul 10 21:32:49.923761 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:49.923430    2575 scope.go:117] "RemoveContainer" containerID="f4336139950c5900b27931893a2ded98a16208f79e64af51cda3bee2d64e04f7"
Jul 10 21:32:49.941048 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:49.941025    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d675976db-x55xm"]
Jul 10 21:32:49.944324 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:49.944300    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d675976db-x55xm"]
Jul 10 21:32:50.601594 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.601560    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:32:50.726693 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.726657    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d675976db-5mt27"]
Jul 10 21:32:50.727008 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.726996    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d2277a-03d7-4ad2-919d-aa234cb90d3b" containerName="manager"
Jul 10 21:32:50.727051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.727009    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d2277a-03d7-4ad2-919d-aa234cb90d3b" containerName="manager"
Jul 10 21:32:50.727087 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.727060    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="45d2277a-03d7-4ad2-919d-aa234cb90d3b" containerName="manager"
Jul 10 21:32:50.731145 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.731125    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d675976db-5mt27"
Jul 10 21:32:50.735403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.735381    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 21:32:50.735525 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.735438    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 21:32:50.735525 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.735447    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-trxx4\""
Jul 10 21:32:50.741125 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.741101    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d675976db-5mt27"]
Jul 10 21:32:50.889407 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.889314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-952z5\" (UniqueName: \"kubernetes.io/projected/fd7ba268-c256-488b-8775-d95abd5ca62b-kube-api-access-952z5\") pod \"maas-controller-6d675976db-5mt27\" (UID: \"fd7ba268-c256-488b-8775-d95abd5ca62b\") " pod="opendatahub/maas-controller-6d675976db-5mt27"
Jul 10 21:32:50.889407 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.889369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd7ba268-c256-488b-8775-d95abd5ca62b-webhook-cert\") pod \"maas-controller-6d675976db-5mt27\" (UID: \"fd7ba268-c256-488b-8775-d95abd5ca62b\") " pod="opendatahub/maas-controller-6d675976db-5mt27"
Jul 10 21:32:50.990704 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.990665    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-952z5\" (UniqueName: \"kubernetes.io/projected/fd7ba268-c256-488b-8775-d95abd5ca62b-kube-api-access-952z5\") pod \"maas-controller-6d675976db-5mt27\" (UID: \"fd7ba268-c256-488b-8775-d95abd5ca62b\") " pod="opendatahub/maas-controller-6d675976db-5mt27"
Jul 10 21:32:50.991169 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.990713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd7ba268-c256-488b-8775-d95abd5ca62b-webhook-cert\") pod \"maas-controller-6d675976db-5mt27\" (UID: \"fd7ba268-c256-488b-8775-d95abd5ca62b\") " pod="opendatahub/maas-controller-6d675976db-5mt27"
Jul 10 21:32:50.993196 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:50.993178    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd7ba268-c256-488b-8775-d95abd5ca62b-webhook-cert\") pod \"maas-controller-6d675976db-5mt27\" (UID: \"fd7ba268-c256-488b-8775-d95abd5ca62b\") " pod="opendatahub/maas-controller-6d675976db-5mt27"
Jul 10 21:32:51.000665 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:51.000640    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-952z5\" (UniqueName: \"kubernetes.io/projected/fd7ba268-c256-488b-8775-d95abd5ca62b-kube-api-access-952z5\") pod \"maas-controller-6d675976db-5mt27\" (UID: \"fd7ba268-c256-488b-8775-d95abd5ca62b\") " pod="opendatahub/maas-controller-6d675976db-5mt27"
Jul 10 21:32:51.043237 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:51.043203    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d675976db-5mt27"
Jul 10 21:32:51.177813 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:51.177790    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d675976db-5mt27"]
Jul 10 21:32:51.179697 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:32:51.179665    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd7ba268_c256_488b_8775_d95abd5ca62b.slice/crio-6fc74087d4a7eb1c747c87bfeef272546f3467ad4d4da22cb155a152972b1b8b WatchSource:0}: Error finding container 6fc74087d4a7eb1c747c87bfeef272546f3467ad4d4da22cb155a152972b1b8b: Status 404 returned error can't find the container with id 6fc74087d4a7eb1c747c87bfeef272546f3467ad4d4da22cb155a152972b1b8b
Jul 10 21:32:51.181019 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:51.181002    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 21:32:51.523262 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:51.523181    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d2277a-03d7-4ad2-919d-aa234cb90d3b" path="/var/lib/kubelet/pods/45d2277a-03d7-4ad2-919d-aa234cb90d3b/volumes"
Jul 10 21:32:51.935801 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:51.935767    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d675976db-5mt27" event={"ID":"fd7ba268-c256-488b-8775-d95abd5ca62b","Type":"ContainerStarted","Data":"7c12e4d9a130614fa776c6ca765604ea657a137323047a9d08ff7c260c5c8645"}
Jul 10 21:32:51.935995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:51.935818    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d675976db-5mt27" event={"ID":"fd7ba268-c256-488b-8775-d95abd5ca62b","Type":"ContainerStarted","Data":"6fc74087d4a7eb1c747c87bfeef272546f3467ad4d4da22cb155a152972b1b8b"}
Jul 10 21:32:51.935995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:51.935841    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d675976db-5mt27"
Jul 10 21:32:51.956362 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:51.956311    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d675976db-5mt27" podStartSLOduration=1.476801859 podStartE2EDuration="1.956295193s" totalImagesPullingTime="479.493334ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:32:51.954691895 +0000 UTC m=+697.587937152" watchObservedRunningTime="2026-07-10 21:32:51.956295193 +0000 UTC m=+697.589540444"
Jul 10 21:32:55.682851 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:32:55.682819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:33:02.944126 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:33:02.944088    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d675976db-5mt27"
Jul 10 21:33:16.905678 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:33:16.905635    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:33:30.999931 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:33:30.999892    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:33:35.433243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:33:35.433202    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:33:35.532364 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:33:35.532332    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:33:35.662693 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:33:35.662661    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:33:41.523369 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:33:41.523330    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:33:41.634806 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:33:41.634772    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:33:41.726722 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:33:41.726687    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:33:41.860747 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:33:41.860717    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:33:47.522805 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:33:47.522766    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:33:47.623584 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:33:47.623554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:34:04.792793 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:34:04.792752    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:34:08.976222 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:34:08.976187    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:34:09.076765 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:34:09.076735    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:34:14.493758 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:34:14.493727    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:34:25.189387 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:34:25.189354    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:34:32.893453 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:34:32.893415    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:34:42.903897 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:34:42.903779    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:34:59.395684 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:34:59.395647    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:35:05.913651 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:35:05.913608    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:35:14.328648 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:35:14.328610    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:35:35.694156 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:35:35.694117    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:35:47.394053 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:35:47.394006    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:36:07.228689 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:36:07.228606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:36:09.290967 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:36:09.290929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:36:11.499516 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:36:11.499481    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:36:15.478391 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:36:15.478364    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:36:15.481134 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:36:15.481108    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:36:25.095382 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:36:25.095328    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:36:37.794512 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:36:37.794475    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:36:47.696916 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:36:47.696863    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:36:58.001897 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:36:58.001859    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:37:09.899125 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:37:09.899085    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:37:16.287694 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:37:16.287656    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:37:16.339557 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:37:16.339517    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:39:05.893299 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:39:05.893245    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:39:18.292016 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:39:18.291981    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:39:21.346795 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:39:21.346760    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:39:27.393687 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:39:27.393651    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:39:37.402175 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:39:37.402137    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:39:54.799781 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:39:54.799738    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:40:04.692251 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:40:04.692211    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:40:16.693825 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:40:16.693788    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:40:23.042421 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:40:23.042387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:40:24.598839 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:40:24.598807    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:40:36.296329 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:40:36.296247    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:40:47.595244 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:40:47.595205    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:40:53.892879 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:40:53.892848    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:41:15.196180 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:41:15.196148    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:41:15.517408 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:41:15.517328    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:41:15.526325 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:41:15.526297    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:41:24.794451 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:41:24.794418    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:41:35.286786 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:41:35.286750    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:41:45.593603 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:41:45.593568    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:41:54.896877 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:41:54.896844    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:42:08.095457 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:42:08.095366    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:42:18.394853 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:42:18.394816    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:42:28.185332 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:42:28.185290    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:42:36.791661 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:42:36.791622    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:42:46.890468 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:42:46.890434    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:42:56.795175 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:42:56.795139    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:43:09.914211 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:43:09.914172    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:43:10.401063 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:43:10.401027    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:43:11.045930 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:43:11.045893    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:43:19.446480 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:43:19.446445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:43:19.547688 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:43:19.547646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:43:24.599111 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:43:24.599069    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:43:34.692939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:43:34.692904    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:43:40.400499 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:43:40.400416    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:43:53.588007 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:43:53.587967    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:44:02.592320 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:44:02.592264    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:44:14.700647 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:44:14.700601    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:44:15.215123 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:44:15.215083    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:44:15.316328 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:44:15.316258    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:44:26.798315 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:44:26.798259    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:44:38.594925 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:44:38.594887    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:44:39.576622 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:44:39.576586    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:44:47.254604 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:44:47.254562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:44:49.301119 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:44:49.301083    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:44:55.256332 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:44:55.256291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:00.389671 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:00.389623    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:03.219528 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:03.219480    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:03.319917 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:03.319881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:03.540422 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:03.540331    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:45:03.603685 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:03.603651    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:09.350136 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:09.350035    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:09.529596 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:09.529560    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:09.670866 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:09.670783    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:09.742050 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:09.742014    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:10.743289 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.743229    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:10.810590 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.810549    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"]
Jul 10 21:45:10.813717 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.813697    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:10.817450 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.817420    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-22c1dfe4-serving-cert\""
Jul 10 21:45:10.817581 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.817452    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-r7zht\""
Jul 10 21:45:10.828922 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.828887    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"]
Jul 10 21:45:10.831580 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.831545    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:10.858191 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.858143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-openshift-service-ca\") pod \"maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:10.858398 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.858195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckqs6\" (UniqueName: \"kubernetes.io/projected/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-kube-api-access-ckqs6\") pod \"maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:10.858398 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.858312    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-maas-api-tls\") pod \"maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:10.896797 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.896762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:10.958952 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.958921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-openshift-service-ca\") pod \"maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:10.959169 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.958961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckqs6\" (UniqueName: \"kubernetes.io/projected/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-kube-api-access-ckqs6\") pod \"maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:10.959169 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.959007    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-maas-api-tls\") pod \"maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:10.959169 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:45:10.959117    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-serving-cert: secret "maas-api-e2e-ait-22c1dfe4-serving-cert" not found
Jul 10 21:45:10.959396 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:45:10.959186    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-maas-api-tls podName:9348b0da-f3dd-4bc3-9f5d-370791ec18f4 nodeName:}" failed. No retries permitted until 2026-07-10 21:45:11.459165096 +0000 UTC m=+1437.092410328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-maas-api-tls") pod "maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7" (UID: "9348b0da-f3dd-4bc3-9f5d-370791ec18f4") : secret "maas-api-e2e-ait-22c1dfe4-serving-cert" not found
Jul 10 21:45:10.959624 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.959603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-openshift-service-ca\") pod \"maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:10.970189 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:10.970160    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckqs6\" (UniqueName: \"kubernetes.io/projected/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-kube-api-access-ckqs6\") pod \"maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:11.087132 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:11.087096    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:11.294725 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:11.294691    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:11.394921 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:11.394814    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:11.463072 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:11.463041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-maas-api-tls\") pod \"maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:11.465920 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:11.465874    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-maas-api-tls\") pod \"maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:11.725956 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:11.725855    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:11.873357 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:11.873329    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"]
Jul 10 21:45:11.874860 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:45:11.874834    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9348b0da_f3dd_4bc3_9f5d_370791ec18f4.slice/crio-bb7e406ef76b9960ca7b4562e55c591a1a083256c2d2e8c7cb70186963c236b5 WatchSource:0}: Error finding container bb7e406ef76b9960ca7b4562e55c591a1a083256c2d2e8c7cb70186963c236b5: Status 404 returned error can't find the container with id bb7e406ef76b9960ca7b4562e55c591a1a083256c2d2e8c7cb70186963c236b5
Jul 10 21:45:11.876321 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:11.876301    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 21:45:12.788581 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:12.788550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7" event={"ID":"9348b0da-f3dd-4bc3-9f5d-370791ec18f4","Type":"ContainerStarted","Data":"bb7e406ef76b9960ca7b4562e55c591a1a083256c2d2e8c7cb70186963c236b5"}
Jul 10 21:45:13.178294 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:13.178239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:13.596492 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:13.596459    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:45:13.794986 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:13.794948    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7" event={"ID":"9348b0da-f3dd-4bc3-9f5d-370791ec18f4","Type":"ContainerStarted","Data":"16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6"}
Jul 10 21:45:13.795178 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:13.795015    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:13.813251 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:13.813188    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7" podStartSLOduration=2.66495561 podStartE2EDuration="3.813170709s" totalImagesPullingTime="1.148215099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:45:13.81070453 +0000 UTC m=+1439.443949784" watchObservedRunningTime="2026-07-10 21:45:13.813170709 +0000 UTC m=+1439.446415962"
Jul 10 21:45:15.746310 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:15.746252    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc"]
Jul 10 21:45:15.749641 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:15.749616    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc"
Jul 10 21:45:15.751980 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:15.751956    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6nw2b\""
Jul 10 21:45:15.758038 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:15.757629    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc"]
Jul 10 21:45:15.799393 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:15.799354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168ff8d7-e684-42db-a7c7-23fe63449565-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc\" (UID: \"168ff8d7-e684-42db-a7c7-23fe63449565\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc"
Jul 10 21:45:15.900427 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:15.900390    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168ff8d7-e684-42db-a7c7-23fe63449565-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc\" (UID: \"168ff8d7-e684-42db-a7c7-23fe63449565\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc"
Jul 10 21:45:15.901048 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:15.901027    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168ff8d7-e684-42db-a7c7-23fe63449565-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc\" (UID: \"168ff8d7-e684-42db-a7c7-23fe63449565\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc"
Jul 10 21:45:16.061640 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:16.061548    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc"
Jul 10 21:45:16.205233 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:16.205205    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc"]
Jul 10 21:45:16.208294 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:45:16.208245    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168ff8d7_e684_42db_a7c7_23fe63449565.slice/crio-f6d9b74b0780b78ac43aead06ffea047dab20e42adcbc363d71f519b001e5328 WatchSource:0}: Error finding container f6d9b74b0780b78ac43aead06ffea047dab20e42adcbc363d71f519b001e5328: Status 404 returned error can't find the container with id f6d9b74b0780b78ac43aead06ffea047dab20e42adcbc363d71f519b001e5328
Jul 10 21:45:16.813115 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:16.813071    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc" event={"ID":"168ff8d7-e684-42db-a7c7-23fe63449565","Type":"ContainerStarted","Data":"f6d9b74b0780b78ac43aead06ffea047dab20e42adcbc363d71f519b001e5328"}
Jul 10 21:45:18.825448 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:18.825415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc" event={"ID":"168ff8d7-e684-42db-a7c7-23fe63449565","Type":"ContainerStarted","Data":"580cfcefcbccc695e155b0f4533fba777e1f999259d03bcde927b46e1f333bd9"}
Jul 10 21:45:18.841085 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:18.841034    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc" podStartSLOduration=1.5784402499999999 podStartE2EDuration="3.841013596s" totalImagesPullingTime="2.262573346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:45:18.840079141 +0000 UTC m=+1444.473324395" watchObservedRunningTime="2026-07-10 21:45:18.841013596 +0000 UTC m=+1444.474259264"
Jul 10 21:45:19.806382 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:19.806354    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:19.832727 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:19.832691    2575 generic.go:356] "Generic (PLEG): container finished" podID="168ff8d7-e684-42db-a7c7-23fe63449565" containerID="580cfcefcbccc695e155b0f4533fba777e1f999259d03bcde927b46e1f333bd9" exitCode=7
Jul 10 21:45:19.833161 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:19.832754    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc" event={"ID":"168ff8d7-e684-42db-a7c7-23fe63449565","Type":"ContainerDied","Data":"580cfcefcbccc695e155b0f4533fba777e1f999259d03bcde927b46e1f333bd9"}
Jul 10 21:45:19.833161 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:19.832993    2575 scope.go:117] "RemoveContainer" containerID="580cfcefcbccc695e155b0f4533fba777e1f999259d03bcde927b46e1f333bd9"
Jul 10 21:45:20.840600 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:20.840566    2575 generic.go:356] "Generic (PLEG): container finished" podID="168ff8d7-e684-42db-a7c7-23fe63449565" containerID="df9fcc80e2e2e4b63ef859023b96f40d4964dc69129ecddf17fd9706a13b27fa" exitCode=0
Jul 10 21:45:20.841055 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:20.840650    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc" event={"ID":"168ff8d7-e684-42db-a7c7-23fe63449565","Type":"ContainerDied","Data":"df9fcc80e2e2e4b63ef859023b96f40d4964dc69129ecddf17fd9706a13b27fa"}
Jul 10 21:45:20.841055 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:20.840715    2575 scope.go:117] "RemoveContainer" containerID="580cfcefcbccc695e155b0f4533fba777e1f999259d03bcde927b46e1f333bd9"
Jul 10 21:45:22.017547 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:22.017523    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc"
Jul 10 21:45:22.057003 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:22.056968    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168ff8d7-e684-42db-a7c7-23fe63449565-maas-api-service-ca\") pod \"168ff8d7-e684-42db-a7c7-23fe63449565\" (UID: \"168ff8d7-e684-42db-a7c7-23fe63449565\") "
Jul 10 21:45:22.057365 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:22.057342    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/168ff8d7-e684-42db-a7c7-23fe63449565-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "168ff8d7-e684-42db-a7c7-23fe63449565" (UID: "168ff8d7-e684-42db-a7c7-23fe63449565"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:45:22.157789 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:22.157716    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168ff8d7-e684-42db-a7c7-23fe63449565-maas-api-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:45:22.854431 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:22.854386    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc" event={"ID":"168ff8d7-e684-42db-a7c7-23fe63449565","Type":"ContainerDied","Data":"f6d9b74b0780b78ac43aead06ffea047dab20e42adcbc363d71f519b001e5328"}
Jul 10 21:45:22.854606 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:22.854444    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6d9b74b0780b78ac43aead06ffea047dab20e42adcbc363d71f519b001e5328"
Jul 10 21:45:22.854606 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:22.854401    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc"
Jul 10 21:45:26.135394 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.135362    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"]
Jul 10 21:45:26.135865 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.135629    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7" podUID="9348b0da-f3dd-4bc3-9f5d-370791ec18f4" containerName="maas-api" containerID="cri-o://16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6" gracePeriod=30
Jul 10 21:45:26.395283 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.395204    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:26.497714 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.497682    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-openshift-service-ca\") pod \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") "
Jul 10 21:45:26.497864 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.497750    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-maas-api-tls\") pod \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") "
Jul 10 21:45:26.497864 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.497774    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckqs6\" (UniqueName: \"kubernetes.io/projected/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-kube-api-access-ckqs6\") pod \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\" (UID: \"9348b0da-f3dd-4bc3-9f5d-370791ec18f4\") "
Jul 10 21:45:26.498128 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.498096    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9348b0da-f3dd-4bc3-9f5d-370791ec18f4" (UID: "9348b0da-f3dd-4bc3-9f5d-370791ec18f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:45:26.500051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.500017    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-kube-api-access-ckqs6" (OuterVolumeSpecName: "kube-api-access-ckqs6") pod "9348b0da-f3dd-4bc3-9f5d-370791ec18f4" (UID: "9348b0da-f3dd-4bc3-9f5d-370791ec18f4"). InnerVolumeSpecName "kube-api-access-ckqs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:45:26.500051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.500022    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9348b0da-f3dd-4bc3-9f5d-370791ec18f4" (UID: "9348b0da-f3dd-4bc3-9f5d-370791ec18f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:45:26.599291 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.599232    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-openshift-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:45:26.599291 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.599262    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-maas-api-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:45:26.599291 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.599292    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckqs6\" (UniqueName: \"kubernetes.io/projected/9348b0da-f3dd-4bc3-9f5d-370791ec18f4-kube-api-access-ckqs6\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:45:26.840916 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.840861    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:26.882154 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.882119    2575 generic.go:356] "Generic (PLEG): container finished" podID="9348b0da-f3dd-4bc3-9f5d-370791ec18f4" containerID="16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6" exitCode=0
Jul 10 21:45:26.882322 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.882191    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"
Jul 10 21:45:26.882322 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.882202    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7" event={"ID":"9348b0da-f3dd-4bc3-9f5d-370791ec18f4","Type":"ContainerDied","Data":"16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6"}
Jul 10 21:45:26.882322 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.882300    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7" event={"ID":"9348b0da-f3dd-4bc3-9f5d-370791ec18f4","Type":"ContainerDied","Data":"bb7e406ef76b9960ca7b4562e55c591a1a083256c2d2e8c7cb70186963c236b5"}
Jul 10 21:45:26.882457 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.882323    2575 scope.go:117] "RemoveContainer" containerID="16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6"
Jul 10 21:45:26.891874 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.891850    2575 scope.go:117] "RemoveContainer" containerID="16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6"
Jul 10 21:45:26.892154 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:45:26.892133    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6\": container with ID starting with 16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6 not found: ID does not exist" containerID="16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6"
Jul 10 21:45:26.892200 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.892162    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6"} err="failed to get container status \"16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6\": rpc error: code = NotFound desc = could not find container \"16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6\": container with ID starting with 16fb10d8443120e7844f9b2de0e3e45962a9a10ed8d81f613635864c93a9cdf6 not found: ID does not exist"
Jul 10 21:45:26.905080 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.905052    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"]
Jul 10 21:45:26.908658 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:26.908639    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22c1dfe4-8578d5c876-vkpd7"]
Jul 10 21:45:27.523530 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:27.523495    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9348b0da-f3dd-4bc3-9f5d-370791ec18f4" path="/var/lib/kubelet/pods/9348b0da-f3dd-4bc3-9f5d-370791ec18f4/volumes"
Jul 10 21:45:28.990396 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:28.990364    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:45:30.825183 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:30.825145    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:36.604594 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:36.604554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:36.705103 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:36.705064    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:41.048804 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.048764    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:41.298108 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.298065    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"]
Jul 10 21:45:41.298704 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.298675    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="168ff8d7-e684-42db-a7c7-23fe63449565" containerName="revoke-keys"
Jul 10 21:45:41.298704 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.298706    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="168ff8d7-e684-42db-a7c7-23fe63449565" containerName="revoke-keys"
Jul 10 21:45:41.298989 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.298740    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9348b0da-f3dd-4bc3-9f5d-370791ec18f4" containerName="maas-api"
Jul 10 21:45:41.298989 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.298749    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9348b0da-f3dd-4bc3-9f5d-370791ec18f4" containerName="maas-api"
Jul 10 21:45:41.298989 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.298851    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="168ff8d7-e684-42db-a7c7-23fe63449565" containerName="revoke-keys"
Jul 10 21:45:41.298989 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.298864    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9348b0da-f3dd-4bc3-9f5d-370791ec18f4" containerName="maas-api"
Jul 10 21:45:41.304945 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.304914    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.307470 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.307444    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e5f00709-openshift-default-dockercfg-x5h5f\""
Jul 10 21:45:41.313713 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.313688    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"]
Jul 10 21:45:41.330288 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.330225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:41.429553 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.429512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6q7n\" (UniqueName: \"kubernetes.io/projected/4bbb40b6-7d83-4074-b976-c87c79310ca9-kube-api-access-t6q7n\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.429553 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.429554    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-podinfo\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.429793 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.429617    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-token\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.429793 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.429644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-workload-certs\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.429793 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.429727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bbb40b6-7d83-4074-b976-c87c79310ca9-istiod-ca-cert\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.429793 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.429761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-data\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.429944 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.429792    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-credential-socket\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.429944 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.429826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-workload-socket\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.429944 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.429844    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-envoy\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.530483 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.530445    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-workload-socket\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.530483 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.530481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-envoy\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.530720 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.530513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6q7n\" (UniqueName: \"kubernetes.io/projected/4bbb40b6-7d83-4074-b976-c87c79310ca9-kube-api-access-t6q7n\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.530720 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.530542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-podinfo\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.530827 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.530748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-token\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.530827 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.530799    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-workload-certs\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.530926 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.530823    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-workload-socket\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.530926 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.530856    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bbb40b6-7d83-4074-b976-c87c79310ca9-istiod-ca-cert\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.530926 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.530881    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-data\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.531088 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.531003    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-credential-socket\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.531088 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.531077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-workload-certs\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.531198 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.531183    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-data\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.531412 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.531384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-credential-socket\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.531624 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.531603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bbb40b6-7d83-4074-b976-c87c79310ca9-istiod-ca-cert\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.533367 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.533346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-envoy\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.533498 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.533483    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-podinfo\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.538899 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.538874    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-token\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.539055 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.539031    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6q7n\" (UniqueName: \"kubernetes.io/projected/4bbb40b6-7d83-4074-b976-c87c79310ca9-kube-api-access-t6q7n\") pod \"e2e-ait-e5f00709-openshift-default-8685564579-t62kt\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") " pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.617822 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.617776    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:41.766111 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.766086    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"]
Jul 10 21:45:41.768107 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:45:41.768075    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbb40b6_7d83_4074_b976_c87c79310ca9.slice/crio-fe9817698c7286320ed4d3ea97418d7a79abe72ae4c10218ba689b94a55d5de4 WatchSource:0}: Error finding container fe9817698c7286320ed4d3ea97418d7a79abe72ae4c10218ba689b94a55d5de4: Status 404 returned error can't find the container with id fe9817698c7286320ed4d3ea97418d7a79abe72ae4c10218ba689b94a55d5de4
Jul 10 21:45:41.770522 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.770481    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:45:41.770607 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.770569    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:45:41.770651 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.770611    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:45:41.969645 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.969556    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt" event={"ID":"4bbb40b6-7d83-4074-b976-c87c79310ca9","Type":"ContainerStarted","Data":"d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759"}
Jul 10 21:45:41.969645 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.969613    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt" event={"ID":"4bbb40b6-7d83-4074-b976-c87c79310ca9","Type":"ContainerStarted","Data":"fe9817698c7286320ed4d3ea97418d7a79abe72ae4c10218ba689b94a55d5de4"}
Jul 10 21:45:41.990921 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:41.990866    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt" podStartSLOduration=0.990842021 podStartE2EDuration="990.842021ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:45:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:45:41.989184356 +0000 UTC m=+1467.622429611" watchObservedRunningTime="2026-07-10 21:45:41.990842021 +0000 UTC m=+1467.624087275"
Jul 10 21:45:42.427927 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.427888    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:42.509785 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.509750    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"]
Jul 10 21:45:42.510455 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.510429    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="168ff8d7-e684-42db-a7c7-23fe63449565" containerName="revoke-keys"
Jul 10 21:45:42.510639 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.510623    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="168ff8d7-e684-42db-a7c7-23fe63449565" containerName="revoke-keys"
Jul 10 21:45:42.510926 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.510893    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="168ff8d7-e684-42db-a7c7-23fe63449565" containerName="revoke-keys"
Jul 10 21:45:42.512879 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.512852    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:42.514631 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.514612    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:42.517716 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.517692    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e5f00709-serving-cert\""
Jul 10 21:45:42.517827 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.517807    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-r7zht\""
Jul 10 21:45:42.524576 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.524548    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"]
Jul 10 21:45:42.579610 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.579568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:42.618189 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.618159    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:42.625217 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.625179    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:42.641429 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.641394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdae77ff-d9db-4931-8e79-3ff0382a7c04-openshift-service-ca\") pod \"maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:42.641599 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.641448    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f459t\" (UniqueName: \"kubernetes.io/projected/cdae77ff-d9db-4931-8e79-3ff0382a7c04-kube-api-access-f459t\") pod \"maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:42.641599 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.641563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdae77ff-d9db-4931-8e79-3ff0382a7c04-maas-api-tls\") pod \"maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:42.742962 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.742872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdae77ff-d9db-4931-8e79-3ff0382a7c04-openshift-service-ca\") pod \"maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:42.742962 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.742926    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f459t\" (UniqueName: \"kubernetes.io/projected/cdae77ff-d9db-4931-8e79-3ff0382a7c04-kube-api-access-f459t\") pod \"maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:42.743153 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.742984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdae77ff-d9db-4931-8e79-3ff0382a7c04-maas-api-tls\") pod \"maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:42.743153 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:45:42.743088    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-serving-cert: secret "maas-api-e2e-ait-e5f00709-serving-cert" not found
Jul 10 21:45:42.743153 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:45:42.743142    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdae77ff-d9db-4931-8e79-3ff0382a7c04-maas-api-tls podName:cdae77ff-d9db-4931-8e79-3ff0382a7c04 nodeName:}" failed. No retries permitted until 2026-07-10 21:45:43.243126057 +0000 UTC m=+1468.876371290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cdae77ff-d9db-4931-8e79-3ff0382a7c04-maas-api-tls") pod "maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4" (UID: "cdae77ff-d9db-4931-8e79-3ff0382a7c04") : secret "maas-api-e2e-ait-e5f00709-serving-cert" not found
Jul 10 21:45:42.743630 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.743608    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdae77ff-d9db-4931-8e79-3ff0382a7c04-openshift-service-ca\") pod \"maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:42.751765 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.751732    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f459t\" (UniqueName: \"kubernetes.io/projected/cdae77ff-d9db-4931-8e79-3ff0382a7c04-kube-api-access-f459t\") pod \"maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:42.807160 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.807119    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:42.975082 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.975047    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:42.976025 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:42.976004    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:43.094542 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:43.094506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:43.198668 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:43.198630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:43.246376 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:43.246346    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdae77ff-d9db-4931-8e79-3ff0382a7c04-maas-api-tls\") pod \"maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:43.248712 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:43.248691    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdae77ff-d9db-4931-8e79-3ff0382a7c04-maas-api-tls\") pod \"maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:43.426855 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:43.426819    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:43.571933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:43.571907    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"]
Jul 10 21:45:43.574356 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:45:43.574328    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdae77ff_d9db_4931_8e79_3ff0382a7c04.slice/crio-445a80a1a4f3903501816ea3e5cdbaadbe413f5fa387fbe24efc03215e238d2a WatchSource:0}: Error finding container 445a80a1a4f3903501816ea3e5cdbaadbe413f5fa387fbe24efc03215e238d2a: Status 404 returned error can't find the container with id 445a80a1a4f3903501816ea3e5cdbaadbe413f5fa387fbe24efc03215e238d2a
Jul 10 21:45:43.982747 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:43.982712    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4" event={"ID":"cdae77ff-d9db-4931-8e79-3ff0382a7c04","Type":"ContainerStarted","Data":"445a80a1a4f3903501816ea3e5cdbaadbe413f5fa387fbe24efc03215e238d2a"}
Jul 10 21:45:44.989517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:44.989472    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4" event={"ID":"cdae77ff-d9db-4931-8e79-3ff0382a7c04","Type":"ContainerStarted","Data":"9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10"}
Jul 10 21:45:44.989955 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:44.989715    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:45.007410 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:45.007334    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4" podStartSLOduration=2.626170944 podStartE2EDuration="3.007311441s" totalImagesPullingTime="381.140497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:45:45.006568479 +0000 UTC m=+1470.639813733" watchObservedRunningTime="2026-07-10 21:45:45.007311441 +0000 UTC m=+1470.640556696"
Jul 10 21:45:45.089428 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:45.089392    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:45:47.397850 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:47.397816    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:47.498940 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:47.498899    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:50.276972 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:50.276937    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:45:51.001831 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:51.001801    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:45:54.040179 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:54.040148    2575 generic.go:356] "Generic (PLEG): container finished" podID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerID="d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759" exitCode=0
Jul 10 21:45:54.040640 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:54.040215    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt" event={"ID":"4bbb40b6-7d83-4074-b976-c87c79310ca9","Type":"ContainerDied","Data":"d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759"}
Jul 10 21:45:54.040640 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:54.040607    2575 scope.go:117] "RemoveContainer" containerID="d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759"
Jul 10 21:45:54.041661 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:54.041633    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:45:54.041778 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:54.041717    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:45:54.041844 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:54.041802    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:45:55.052607 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:55.052570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt" event={"ID":"4bbb40b6-7d83-4074-b976-c87c79310ca9","Type":"ContainerStarted","Data":"135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b"}
Jul 10 21:45:55.618385 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:55.618347    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:55.619482 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:55.619454    2575 patch_prober.go:28] interesting pod/e2e-ait-e5f00709-openshift-default-8685564579-t62kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 10 21:45:55.619605 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:55.619504    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt" podUID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 10 21:45:56.618306 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:56.618255    2575 patch_prober.go:28] interesting pod/e2e-ait-e5f00709-openshift-default-8685564579-t62kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 10 21:45:56.618687 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:56.618330    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt" podUID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 10 21:45:57.619122 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:57.619087    2575 patch_prober.go:28] interesting pod/e2e-ait-e5f00709-openshift-default-8685564579-t62kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 10 21:45:57.619530 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:57.619152    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt" podUID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 10 21:45:57.975703 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:57.975606    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:58.618299 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:58.618248    2575 patch_prober.go:28] interesting pod/e2e-ait-e5f00709-openshift-default-8685564579-t62kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 10 21:45:58.618522 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:58.618338    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt" podUID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 10 21:45:59.622580 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:59.622549    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:59.623672 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:59.623653    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:45:59.845544 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:45:59.845507    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:46:10.974774 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:10.974710    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:46:15.561471 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:15.561444    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:46:15.569430 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:15.569046    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:46:47.981159 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:47.981065    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"]
Jul 10 21:46:47.982164 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:47.982112    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4" podUID="cdae77ff-d9db-4931-8e79-3ff0382a7c04" containerName="maas-api" containerID="cri-o://9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10" gracePeriod=30
Jul 10 21:46:48.011902 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.011857    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:46:48.237867 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.237789    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:46:48.335775 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.335723    2575 generic.go:356] "Generic (PLEG): container finished" podID="cdae77ff-d9db-4931-8e79-3ff0382a7c04" containerID="9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10" exitCode=0
Jul 10 21:46:48.335775 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.335780    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"
Jul 10 21:46:48.336021 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.335814    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4" event={"ID":"cdae77ff-d9db-4931-8e79-3ff0382a7c04","Type":"ContainerDied","Data":"9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10"}
Jul 10 21:46:48.336021 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.335890    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4" event={"ID":"cdae77ff-d9db-4931-8e79-3ff0382a7c04","Type":"ContainerDied","Data":"445a80a1a4f3903501816ea3e5cdbaadbe413f5fa387fbe24efc03215e238d2a"}
Jul 10 21:46:48.336021 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.335913    2575 scope.go:117] "RemoveContainer" containerID="9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10"
Jul 10 21:46:48.337367 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.337334    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdae77ff-d9db-4931-8e79-3ff0382a7c04-openshift-service-ca\") pod \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") "
Jul 10 21:46:48.337473 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.337402    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f459t\" (UniqueName: \"kubernetes.io/projected/cdae77ff-d9db-4931-8e79-3ff0382a7c04-kube-api-access-f459t\") pod \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") "
Jul 10 21:46:48.337531 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.337491    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdae77ff-d9db-4931-8e79-3ff0382a7c04-maas-api-tls\") pod \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\" (UID: \"cdae77ff-d9db-4931-8e79-3ff0382a7c04\") "
Jul 10 21:46:48.337727 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.337695    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdae77ff-d9db-4931-8e79-3ff0382a7c04-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cdae77ff-d9db-4931-8e79-3ff0382a7c04" (UID: "cdae77ff-d9db-4931-8e79-3ff0382a7c04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:46:48.337925 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.337902    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdae77ff-d9db-4931-8e79-3ff0382a7c04-openshift-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:46:48.339572 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.339542    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdae77ff-d9db-4931-8e79-3ff0382a7c04-kube-api-access-f459t" (OuterVolumeSpecName: "kube-api-access-f459t") pod "cdae77ff-d9db-4931-8e79-3ff0382a7c04" (UID: "cdae77ff-d9db-4931-8e79-3ff0382a7c04"). InnerVolumeSpecName "kube-api-access-f459t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:46:48.339668 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.339578    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdae77ff-d9db-4931-8e79-3ff0382a7c04-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cdae77ff-d9db-4931-8e79-3ff0382a7c04" (UID: "cdae77ff-d9db-4931-8e79-3ff0382a7c04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:46:48.356243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.356222    2575 scope.go:117] "RemoveContainer" containerID="9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10"
Jul 10 21:46:48.356573 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:46:48.356551    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10\": container with ID starting with 9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10 not found: ID does not exist" containerID="9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10"
Jul 10 21:46:48.356627 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.356583    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10"} err="failed to get container status \"9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10\": rpc error: code = NotFound desc = could not find container \"9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10\": container with ID starting with 9b2b7605d8b92d5eea767c0355927b7792bae52c3e848c703551682d28562c10 not found: ID does not exist"
Jul 10 21:46:48.438425 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.438373    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f459t\" (UniqueName: \"kubernetes.io/projected/cdae77ff-d9db-4931-8e79-3ff0382a7c04-kube-api-access-f459t\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:46:48.438425 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.438421    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdae77ff-d9db-4931-8e79-3ff0382a7c04-maas-api-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:46:48.660077 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.660039    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"]
Jul 10 21:46:48.664523 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:48.664495    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e5f00709-79566b77f7-d4ts4"]
Jul 10 21:46:49.523551 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:49.523519    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdae77ff-d9db-4931-8e79-3ff0382a7c04" path="/var/lib/kubelet/pods/cdae77ff-d9db-4931-8e79-3ff0382a7c04/volumes"
Jul 10 21:46:51.090433 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:51.090400    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:46:52.679369 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:52.679326    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:46:59.000374 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:59.000334    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:46:59.069154 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:46:59.069113    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:47:03.661631 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:03.661599    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"]
Jul 10 21:47:03.662071 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:03.661848    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt" podUID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerName="istio-proxy" containerID="cri-o://135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b" gracePeriod=30
Jul 10 21:47:03.686457 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:03.686420    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:47:04.037224 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:04.037190    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:47:05.222032 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.221980    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:47:05.309463 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.309429    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"]
Jul 10 21:47:05.309982 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.309960    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdae77ff-d9db-4931-8e79-3ff0382a7c04" containerName="maas-api"
Jul 10 21:47:05.309982 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.309984    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdae77ff-d9db-4931-8e79-3ff0382a7c04" containerName="maas-api"
Jul 10 21:47:05.310154 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.310079    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdae77ff-d9db-4931-8e79-3ff0382a7c04" containerName="maas-api"
Jul 10 21:47:05.314560 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.314534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:05.314713 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.314561    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:47:05.317357 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.317330    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-2fe53472-serving-cert\""
Jul 10 21:47:05.317466 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.317446    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-r7zht\""
Jul 10 21:47:05.326989 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.326960    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"]
Jul 10 21:47:05.390413 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.390374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef49795e-380d-4bc4-8aec-de42be54c7db-maas-api-tls\") pod \"maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:05.390643 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.390426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef49795e-380d-4bc4-8aec-de42be54c7db-openshift-service-ca\") pod \"maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:05.390643 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.390548    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dg5m\" (UniqueName: \"kubernetes.io/projected/ef49795e-380d-4bc4-8aec-de42be54c7db-kube-api-access-5dg5m\") pod \"maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:05.402238 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.402196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:47:05.492027 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.491930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dg5m\" (UniqueName: \"kubernetes.io/projected/ef49795e-380d-4bc4-8aec-de42be54c7db-kube-api-access-5dg5m\") pod \"maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:05.492208 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.492039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef49795e-380d-4bc4-8aec-de42be54c7db-maas-api-tls\") pod \"maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:05.492208 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.492073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef49795e-380d-4bc4-8aec-de42be54c7db-openshift-service-ca\") pod \"maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:05.492208 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:47:05.492198    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-serving-cert: secret "maas-api-e2e-derive-2fe53472-serving-cert" not found
Jul 10 21:47:05.492407 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:47:05.492297    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef49795e-380d-4bc4-8aec-de42be54c7db-maas-api-tls podName:ef49795e-380d-4bc4-8aec-de42be54c7db nodeName:}" failed. No retries permitted until 2026-07-10 21:47:05.992255155 +0000 UTC m=+1551.625500406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef49795e-380d-4bc4-8aec-de42be54c7db-maas-api-tls") pod "maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd" (UID: "ef49795e-380d-4bc4-8aec-de42be54c7db") : secret "maas-api-e2e-derive-2fe53472-serving-cert" not found
Jul 10 21:47:05.492918 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.492885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef49795e-380d-4bc4-8aec-de42be54c7db-openshift-service-ca\") pod \"maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:05.507129 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.507097    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dg5m\" (UniqueName: \"kubernetes.io/projected/ef49795e-380d-4bc4-8aec-de42be54c7db-kube-api-access-5dg5m\") pod \"maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:05.998121 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:05.998084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef49795e-380d-4bc4-8aec-de42be54c7db-maas-api-tls\") pod \"maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:05.998328 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:47:05.998236    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-serving-cert: secret "maas-api-e2e-derive-2fe53472-serving-cert" not found
Jul 10 21:47:05.998328 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:47:05.998322    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef49795e-380d-4bc4-8aec-de42be54c7db-maas-api-tls podName:ef49795e-380d-4bc4-8aec-de42be54c7db nodeName:}" failed. No retries permitted until 2026-07-10 21:47:06.998305282 +0000 UTC m=+1552.631550519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef49795e-380d-4bc4-8aec-de42be54c7db-maas-api-tls") pod "maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd" (UID: "ef49795e-380d-4bc4-8aec-de42be54c7db") : secret "maas-api-e2e-derive-2fe53472-serving-cert" not found
Jul 10 21:47:06.021597 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:06.021563    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:47:06.124741 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:06.124704    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:47:06.335660 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:06.335622    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:47:07.008834 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:07.008800    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef49795e-380d-4bc4-8aec-de42be54c7db-maas-api-tls\") pod \"maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:07.011244 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:07.011213    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef49795e-380d-4bc4-8aec-de42be54c7db-maas-api-tls\") pod \"maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:07.125420 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:07.125378    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:07.266453 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:07.266428    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"]
Jul 10 21:47:07.267848 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:47:07.267811    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef49795e_380d_4bc4_8aec_de42be54c7db.slice/crio-8ed6714b849a9f4a6a267c06a099d8b7770f8d4b8c1a0f90c77b1a04634238b9 WatchSource:0}: Error finding container 8ed6714b849a9f4a6a267c06a099d8b7770f8d4b8c1a0f90c77b1a04634238b9: Status 404 returned error can't find the container with id 8ed6714b849a9f4a6a267c06a099d8b7770f8d4b8c1a0f90c77b1a04634238b9
Jul 10 21:47:07.436320 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:07.436261    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd" event={"ID":"ef49795e-380d-4bc4-8aec-de42be54c7db","Type":"ContainerStarted","Data":"8ed6714b849a9f4a6a267c06a099d8b7770f8d4b8c1a0f90c77b1a04634238b9"}
Jul 10 21:47:07.988684 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:07.988648    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:47:08.444336 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:08.444296    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd" event={"ID":"ef49795e-380d-4bc4-8aec-de42be54c7db","Type":"ContainerStarted","Data":"2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5"}
Jul 10 21:47:08.444751 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:08.444414    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:08.465293 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:08.465218    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd" podStartSLOduration=2.510894974 podStartE2EDuration="3.46520125s" totalImagesPullingTime="954.306276ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:47:08.462934661 +0000 UTC m=+1554.096179915" watchObservedRunningTime="2026-07-10 21:47:08.46520125 +0000 UTC m=+1554.098446546"
Jul 10 21:47:08.909548 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:08.909524    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:47:09.025640 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.025596    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-workload-certs\") pod \"4bbb40b6-7d83-4074-b976-c87c79310ca9\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") "
Jul 10 21:47:09.025806 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.025664    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-data\") pod \"4bbb40b6-7d83-4074-b976-c87c79310ca9\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") "
Jul 10 21:47:09.025806 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.025688    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-workload-socket\") pod \"4bbb40b6-7d83-4074-b976-c87c79310ca9\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") "
Jul 10 21:47:09.025806 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.025720    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bbb40b6-7d83-4074-b976-c87c79310ca9-istiod-ca-cert\") pod \"4bbb40b6-7d83-4074-b976-c87c79310ca9\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") "
Jul 10 21:47:09.025806 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.025740    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-envoy\") pod \"4bbb40b6-7d83-4074-b976-c87c79310ca9\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") "
Jul 10 21:47:09.025806 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.025768    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-token\") pod \"4bbb40b6-7d83-4074-b976-c87c79310ca9\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") "
Jul 10 21:47:09.025806 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.025799    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-podinfo\") pod \"4bbb40b6-7d83-4074-b976-c87c79310ca9\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") "
Jul 10 21:47:09.026123 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.025829    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-credential-socket\") pod \"4bbb40b6-7d83-4074-b976-c87c79310ca9\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") "
Jul 10 21:47:09.026123 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.025903    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4bbb40b6-7d83-4074-b976-c87c79310ca9" (UID: "4bbb40b6-7d83-4074-b976-c87c79310ca9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:47:09.026123 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.025916    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6q7n\" (UniqueName: \"kubernetes.io/projected/4bbb40b6-7d83-4074-b976-c87c79310ca9-kube-api-access-t6q7n\") pod \"4bbb40b6-7d83-4074-b976-c87c79310ca9\" (UID: \"4bbb40b6-7d83-4074-b976-c87c79310ca9\") "
Jul 10 21:47:09.026123 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.025995    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4bbb40b6-7d83-4074-b976-c87c79310ca9" (UID: "4bbb40b6-7d83-4074-b976-c87c79310ca9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:47:09.026337 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.026226    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bbb40b6-7d83-4074-b976-c87c79310ca9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4bbb40b6-7d83-4074-b976-c87c79310ca9" (UID: "4bbb40b6-7d83-4074-b976-c87c79310ca9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:47:09.026337 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.026259    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-workload-certs\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:47:09.026337 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.026301    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-workload-socket\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:47:09.026654 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.026628    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-data" (OuterVolumeSpecName: "istio-data") pod "4bbb40b6-7d83-4074-b976-c87c79310ca9" (UID: "4bbb40b6-7d83-4074-b976-c87c79310ca9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:47:09.026654 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.026637    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4bbb40b6-7d83-4074-b976-c87c79310ca9" (UID: "4bbb40b6-7d83-4074-b976-c87c79310ca9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:47:09.028120 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.028096    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4bbb40b6-7d83-4074-b976-c87c79310ca9" (UID: "4bbb40b6-7d83-4074-b976-c87c79310ca9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:47:09.028203 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.028119    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4bbb40b6-7d83-4074-b976-c87c79310ca9" (UID: "4bbb40b6-7d83-4074-b976-c87c79310ca9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 21:47:09.028450 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.028429    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bbb40b6-7d83-4074-b976-c87c79310ca9-kube-api-access-t6q7n" (OuterVolumeSpecName: "kube-api-access-t6q7n") pod "4bbb40b6-7d83-4074-b976-c87c79310ca9" (UID: "4bbb40b6-7d83-4074-b976-c87c79310ca9"). InnerVolumeSpecName "kube-api-access-t6q7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:47:09.028511 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.028461    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-token" (OuterVolumeSpecName: "istio-token") pod "4bbb40b6-7d83-4074-b976-c87c79310ca9" (UID: "4bbb40b6-7d83-4074-b976-c87c79310ca9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:47:09.127649 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.127610    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6q7n\" (UniqueName: \"kubernetes.io/projected/4bbb40b6-7d83-4074-b976-c87c79310ca9-kube-api-access-t6q7n\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:47:09.127649 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.127641    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-data\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:47:09.127649 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.127652    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bbb40b6-7d83-4074-b976-c87c79310ca9-istiod-ca-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:47:09.127649 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.127660    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-envoy\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:47:09.127934 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.127668    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-token\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:47:09.127934 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.127676    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bbb40b6-7d83-4074-b976-c87c79310ca9-istio-podinfo\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:47:09.127934 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.127683    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bbb40b6-7d83-4074-b976-c87c79310ca9-credential-socket\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:47:09.451417 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.451382    2575 generic.go:356] "Generic (PLEG): container finished" podID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerID="135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b" exitCode=0
Jul 10 21:47:09.451894 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.451425    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"
Jul 10 21:47:09.451894 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.451452    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt" event={"ID":"4bbb40b6-7d83-4074-b976-c87c79310ca9","Type":"ContainerDied","Data":"135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b"}
Jul 10 21:47:09.451894 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.451520    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt" event={"ID":"4bbb40b6-7d83-4074-b976-c87c79310ca9","Type":"ContainerDied","Data":"fe9817698c7286320ed4d3ea97418d7a79abe72ae4c10218ba689b94a55d5de4"}
Jul 10 21:47:09.451894 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.451553    2575 scope.go:117] "RemoveContainer" containerID="135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b"
Jul 10 21:47:09.461907 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.461889    2575 scope.go:117] "RemoveContainer" containerID="d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759"
Jul 10 21:47:09.470474 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.470457    2575 scope.go:117] "RemoveContainer" containerID="135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b"
Jul 10 21:47:09.470736 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:47:09.470717    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b\": container with ID starting with 135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b not found: ID does not exist" containerID="135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b"
Jul 10 21:47:09.470787 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.470746    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b"} err="failed to get container status \"135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b\": rpc error: code = NotFound desc = could not find container \"135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b\": container with ID starting with 135d30ac64a20425f36845f6fe9caee531b44f925da890336d49ac0dfc1bbb8b not found: ID does not exist"
Jul 10 21:47:09.470787 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.470763    2575 scope.go:117] "RemoveContainer" containerID="d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759"
Jul 10 21:47:09.470999 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:47:09.470980    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759\": container with ID starting with d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759 not found: ID does not exist" containerID="d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759"
Jul 10 21:47:09.471051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.471001    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759"} err="failed to get container status \"d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759\": rpc error: code = NotFound desc = could not find container \"d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759\": container with ID starting with d687b949f43e7d7b9130663fa3ea857142d289905033faaa314f7ae149f5f759 not found: ID does not exist"
Jul 10 21:47:09.476284 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.476249    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"]
Jul 10 21:47:09.479559 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.479540    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e5f00709-openshift-default-8685564579-t62kt"]
Jul 10 21:47:09.523545 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:09.523513    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bbb40b6-7d83-4074-b976-c87c79310ca9" path="/var/lib/kubelet/pods/4bbb40b6-7d83-4074-b976-c87c79310ca9/volumes"
Jul 10 21:47:10.369939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:10.369906    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:47:10.470840 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:10.470744    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:47:13.872265 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:13.872230    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:47:14.457436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:14.457409    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:47:25.772619 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:47:25.772573    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:15.010985 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:15.010949    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:16.215581 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:16.215544    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:20.074430 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.074395    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:20.295264 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.295233    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"]
Jul 10 21:48:20.295636 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.295603    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd" podUID="ef49795e-380d-4bc4-8aec-de42be54c7db" containerName="maas-api" containerID="cri-o://2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5" gracePeriod=30
Jul 10 21:48:20.346681 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.346651    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:20.447682 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.447651    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:20.554871 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.554847    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:48:20.665953 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.665857    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef49795e-380d-4bc4-8aec-de42be54c7db-maas-api-tls\") pod \"ef49795e-380d-4bc4-8aec-de42be54c7db\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") "
Jul 10 21:48:20.665953 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.665911    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dg5m\" (UniqueName: \"kubernetes.io/projected/ef49795e-380d-4bc4-8aec-de42be54c7db-kube-api-access-5dg5m\") pod \"ef49795e-380d-4bc4-8aec-de42be54c7db\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") "
Jul 10 21:48:20.665953 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.665949    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef49795e-380d-4bc4-8aec-de42be54c7db-openshift-service-ca\") pod \"ef49795e-380d-4bc4-8aec-de42be54c7db\" (UID: \"ef49795e-380d-4bc4-8aec-de42be54c7db\") "
Jul 10 21:48:20.666465 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.666437    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef49795e-380d-4bc4-8aec-de42be54c7db-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef49795e-380d-4bc4-8aec-de42be54c7db" (UID: "ef49795e-380d-4bc4-8aec-de42be54c7db"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:48:20.668064 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.668041    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef49795e-380d-4bc4-8aec-de42be54c7db-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef49795e-380d-4bc4-8aec-de42be54c7db" (UID: "ef49795e-380d-4bc4-8aec-de42be54c7db"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:48:20.668161 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.668133    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef49795e-380d-4bc4-8aec-de42be54c7db-kube-api-access-5dg5m" (OuterVolumeSpecName: "kube-api-access-5dg5m") pod "ef49795e-380d-4bc4-8aec-de42be54c7db" (UID: "ef49795e-380d-4bc4-8aec-de42be54c7db"). InnerVolumeSpecName "kube-api-access-5dg5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:48:20.767370 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.767330    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dg5m\" (UniqueName: \"kubernetes.io/projected/ef49795e-380d-4bc4-8aec-de42be54c7db-kube-api-access-5dg5m\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:48:20.767370 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.767365    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef49795e-380d-4bc4-8aec-de42be54c7db-openshift-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:48:20.767579 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.767402    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef49795e-380d-4bc4-8aec-de42be54c7db-maas-api-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:48:20.846963 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.846926    2575 generic.go:356] "Generic (PLEG): container finished" podID="ef49795e-380d-4bc4-8aec-de42be54c7db" containerID="2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5" exitCode=0
Jul 10 21:48:20.847155 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.846970    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"
Jul 10 21:48:20.847155 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.847012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd" event={"ID":"ef49795e-380d-4bc4-8aec-de42be54c7db","Type":"ContainerDied","Data":"2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5"}
Jul 10 21:48:20.847155 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.847069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd" event={"ID":"ef49795e-380d-4bc4-8aec-de42be54c7db","Type":"ContainerDied","Data":"8ed6714b849a9f4a6a267c06a099d8b7770f8d4b8c1a0f90c77b1a04634238b9"}
Jul 10 21:48:20.847155 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.847099    2575 scope.go:117] "RemoveContainer" containerID="2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5"
Jul 10 21:48:20.859081 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.859059    2575 scope.go:117] "RemoveContainer" containerID="2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5"
Jul 10 21:48:20.859442 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:48:20.859420    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5\": container with ID starting with 2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5 not found: ID does not exist" containerID="2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5"
Jul 10 21:48:20.859530 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.859452    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5"} err="failed to get container status \"2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5\": rpc error: code = NotFound desc = could not find container \"2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5\": container with ID starting with 2773172f9d7102171a4ace219ef1be5037ddda645b1a8ccfa0e9aa5523184ae5 not found: ID does not exist"
Jul 10 21:48:20.870719 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.870691    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"]
Jul 10 21:48:20.876315 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:20.876283    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2fe53472-679c8b7c76-29lsd"]
Jul 10 21:48:21.523177 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:21.523142    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef49795e-380d-4bc4-8aec-de42be54c7db" path="/var/lib/kubelet/pods/ef49795e-380d-4bc4-8aec-de42be54c7db/volumes"
Jul 10 21:48:23.391924 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:23.391888    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:48:24.765207 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:24.765165    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:30.443382 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:30.443343    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:30.499155 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:30.499117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:34.831088 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:34.831046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:35.407548 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:35.407512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:35.507194 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:35.507154    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:35.608149 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:35.608114    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:37.005980 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:37.005939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:42.916350 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:42.916302    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:42.980518 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:42.980477    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:43.056153 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:43.056118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:43.162639 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:43.162602    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:43.261191 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:43.261094    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:43.621718 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:43.621667    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:48:46.457734 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:48:46.457700    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:09.609237 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:09.609188    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:15.425341 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:15.425299    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:15.532196 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:15.532155    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:15.629840 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:15.629801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:31.511768 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:31.511717    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:37.220103 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:37.219992    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:37.325853 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:37.325815    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:37.421010 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:37.420976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:47.919048 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:47.919008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:48.699811 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:48.699749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:54.312008 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:54.311969    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:54.419113 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:54.419073    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:54.512229 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:54.512188    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:54.574362 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:54.574237    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:55.334212 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:55.334178    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:55.434848 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:55.434808    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:55.540737 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:55.540698    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:57.108500 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:57.108464    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:49:57.897131 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:49:57.897091    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:50:03.138254 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:03.138217    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:03.239183 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:03.239147    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:03.792565 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:03.792524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:05.690138 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:05.690106    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:50:09.651120 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:09.651079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:09.710758 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:09.710728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:09.889432 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:09.889390    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:10.194609 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:10.194574    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:10.350523 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:10.350485    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:13.269643 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.269604    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:13.371071 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.371031    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:13.508335 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.508297    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"]
Jul 10 21:50:13.508837 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.508821    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerName="istio-proxy"
Jul 10 21:50:13.508881 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.508840    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerName="istio-proxy"
Jul 10 21:50:13.508881 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.508859    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef49795e-380d-4bc4-8aec-de42be54c7db" containerName="maas-api"
Jul 10 21:50:13.508881 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.508867    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef49795e-380d-4bc4-8aec-de42be54c7db" containerName="maas-api"
Jul 10 21:50:13.508981 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.508974    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef49795e-380d-4bc4-8aec-de42be54c7db" containerName="maas-api"
Jul 10 21:50:13.509014 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.508986    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerName="istio-proxy"
Jul 10 21:50:13.509014 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.508996    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerName="istio-proxy"
Jul 10 21:50:13.512545 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.512525    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:13.514820 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.514800    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-fa2f395f-serving-cert\""
Jul 10 21:50:13.514956 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.514927    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-r7zht\""
Jul 10 21:50:13.525504 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.525480    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"]
Jul 10 21:50:13.536078 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.536037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3b623e-b727-4819-8410-1887d0e5812e-maas-api-tls\") pod \"maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:13.536228 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.536111    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89jdb\" (UniqueName: \"kubernetes.io/projected/2c3b623e-b727-4819-8410-1887d0e5812e-kube-api-access-89jdb\") pod \"maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:13.536228 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.536139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3b623e-b727-4819-8410-1887d0e5812e-openshift-service-ca\") pod \"maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:13.536228 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.536152    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:13.636838 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.636807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3b623e-b727-4819-8410-1887d0e5812e-maas-api-tls\") pod \"maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:13.637015 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.636858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89jdb\" (UniqueName: \"kubernetes.io/projected/2c3b623e-b727-4819-8410-1887d0e5812e-kube-api-access-89jdb\") pod \"maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:13.637015 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.636880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3b623e-b727-4819-8410-1887d0e5812e-openshift-service-ca\") pod \"maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:13.637015 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:50:13.636983    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-serving-cert: secret "maas-api-e2e-mt-fa2f395f-serving-cert" not found
Jul 10 21:50:13.637124 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:50:13.637063    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3b623e-b727-4819-8410-1887d0e5812e-maas-api-tls podName:2c3b623e-b727-4819-8410-1887d0e5812e nodeName:}" failed. No retries permitted until 2026-07-10 21:50:14.137042994 +0000 UTC m=+1739.770288239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c3b623e-b727-4819-8410-1887d0e5812e-maas-api-tls") pod "maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs" (UID: "2c3b623e-b727-4819-8410-1887d0e5812e") : secret "maas-api-e2e-mt-fa2f395f-serving-cert" not found
Jul 10 21:50:13.637494 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.637477    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3b623e-b727-4819-8410-1887d0e5812e-openshift-service-ca\") pod \"maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:13.647307 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.647267    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89jdb\" (UniqueName: \"kubernetes.io/projected/2c3b623e-b727-4819-8410-1887d0e5812e-kube-api-access-89jdb\") pod \"maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:13.822937 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:13.822841    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:14.100671 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:14.100638    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:14.141785 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:14.141754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3b623e-b727-4819-8410-1887d0e5812e-maas-api-tls\") pod \"maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:14.144158 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:14.144134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3b623e-b727-4819-8410-1887d0e5812e-maas-api-tls\") pod \"maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:14.203105 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:14.203069    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:14.425889 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:14.425797    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:14.568861 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:14.568835    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"]
Jul 10 21:50:14.570623 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:50:14.570598    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3b623e_b727_4819_8410_1887d0e5812e.slice/crio-32dbed0f0a7ec87af51a4b9f9d3a6f13d5c7ec6a2c63ce057da739e59285ae51 WatchSource:0}: Error finding container 32dbed0f0a7ec87af51a4b9f9d3a6f13d5c7ec6a2c63ce057da739e59285ae51: Status 404 returned error can't find the container with id 32dbed0f0a7ec87af51a4b9f9d3a6f13d5c7ec6a2c63ce057da739e59285ae51
Jul 10 21:50:14.572424 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:14.572401    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 21:50:15.459420 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:15.459379    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs" event={"ID":"2c3b623e-b727-4819-8410-1887d0e5812e","Type":"ContainerStarted","Data":"59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de"}
Jul 10 21:50:15.459882 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:15.459434    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs" event={"ID":"2c3b623e-b727-4819-8410-1887d0e5812e","Type":"ContainerStarted","Data":"32dbed0f0a7ec87af51a4b9f9d3a6f13d5c7ec6a2c63ce057da739e59285ae51"}
Jul 10 21:50:15.459882 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:15.459473    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:15.476818 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:15.476773    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs" podStartSLOduration=2.039875954 podStartE2EDuration="2.476757766s" totalImagesPullingTime="436.881812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:50:15.474369508 +0000 UTC m=+1741.107614762" watchObservedRunningTime="2026-07-10 21:50:15.476757766 +0000 UTC m=+1741.110003023"
Jul 10 21:50:17.749527 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:17.749492    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:18.402914 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:18.402878    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:18.496635 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:18.496598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:18.800050 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:18.799960    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:20.493045 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:20.492964    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:50:21.470181 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:21.470152    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:24.418350 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:24.418316    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:24.479012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:24.478978    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:35.286449 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.286416    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"]
Jul 10 21:50:35.287020 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.286674    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs" podUID="2c3b623e-b727-4819-8410-1887d0e5812e" containerName="maas-api" containerID="cri-o://59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de" gracePeriod=30
Jul 10 21:50:35.319380 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.319351    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:35.549759 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.549693    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:35.575114 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.575081    2575 generic.go:356] "Generic (PLEG): container finished" podID="2c3b623e-b727-4819-8410-1887d0e5812e" containerID="59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de" exitCode=0
Jul 10 21:50:35.575114 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.575118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs" event={"ID":"2c3b623e-b727-4819-8410-1887d0e5812e","Type":"ContainerDied","Data":"59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de"}
Jul 10 21:50:35.575385 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.575132    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"
Jul 10 21:50:35.575385 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.575152    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs" event={"ID":"2c3b623e-b727-4819-8410-1887d0e5812e","Type":"ContainerDied","Data":"32dbed0f0a7ec87af51a4b9f9d3a6f13d5c7ec6a2c63ce057da739e59285ae51"}
Jul 10 21:50:35.575385 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.575172    2575 scope.go:117] "RemoveContainer" containerID="59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de"
Jul 10 21:50:35.583889 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.583871    2575 scope.go:117] "RemoveContainer" containerID="59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de"
Jul 10 21:50:35.584174 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:50:35.584155    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de\": container with ID starting with 59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de not found: ID does not exist" containerID="59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de"
Jul 10 21:50:35.584240 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.584186    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de"} err="failed to get container status \"59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de\": rpc error: code = NotFound desc = could not find container \"59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de\": container with ID starting with 59d123251b3cc9f6e34af449325bf9b976aebd8a66c841c695c057d81e62d3de not found: ID does not exist"
Jul 10 21:50:35.612698 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.612664    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89jdb\" (UniqueName: \"kubernetes.io/projected/2c3b623e-b727-4819-8410-1887d0e5812e-kube-api-access-89jdb\") pod \"2c3b623e-b727-4819-8410-1887d0e5812e\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") "
Jul 10 21:50:35.612698 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.612704    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3b623e-b727-4819-8410-1887d0e5812e-openshift-service-ca\") pod \"2c3b623e-b727-4819-8410-1887d0e5812e\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") "
Jul 10 21:50:35.612927 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.612754    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3b623e-b727-4819-8410-1887d0e5812e-maas-api-tls\") pod \"2c3b623e-b727-4819-8410-1887d0e5812e\" (UID: \"2c3b623e-b727-4819-8410-1887d0e5812e\") "
Jul 10 21:50:35.613143 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.613121    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c3b623e-b727-4819-8410-1887d0e5812e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2c3b623e-b727-4819-8410-1887d0e5812e" (UID: "2c3b623e-b727-4819-8410-1887d0e5812e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:50:35.614872 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.614842    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3b623e-b727-4819-8410-1887d0e5812e-kube-api-access-89jdb" (OuterVolumeSpecName: "kube-api-access-89jdb") pod "2c3b623e-b727-4819-8410-1887d0e5812e" (UID: "2c3b623e-b727-4819-8410-1887d0e5812e"). InnerVolumeSpecName "kube-api-access-89jdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:50:35.614872 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.614857    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3b623e-b727-4819-8410-1887d0e5812e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2c3b623e-b727-4819-8410-1887d0e5812e" (UID: "2c3b623e-b727-4819-8410-1887d0e5812e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:50:35.713897 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.713866    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89jdb\" (UniqueName: \"kubernetes.io/projected/2c3b623e-b727-4819-8410-1887d0e5812e-kube-api-access-89jdb\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:50:35.713897 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.713894    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3b623e-b727-4819-8410-1887d0e5812e-openshift-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:50:35.713897 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.713907    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3b623e-b727-4819-8410-1887d0e5812e-maas-api-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:50:35.899913 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.899879    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"]
Jul 10 21:50:35.902583 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:35.902551    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa2f395f-74b967d6f6-jx9rs"]
Jul 10 21:50:37.522806 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:37.522772    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c3b623e-b727-4819-8410-1887d0e5812e" path="/var/lib/kubelet/pods/2c3b623e-b727-4819-8410-1887d0e5812e/volumes"
Jul 10 21:50:37.992219 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:37.992185    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:50:39.841023 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:39.840982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:45.668534 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:45.668497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:45.723613 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:45.723577    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:50.502411 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:50.502371    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:50.727134 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:50.727101    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:50.847885 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:50.847819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:50.945158 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:50.945118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:51.081585 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:51.081552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:56.897152 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:56.897111    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:56.960333 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:56.960290    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:57.046337 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:57.046297    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:57.147510 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:57.147413    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:50:57.245362 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:50:57.245329    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:02.834474 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:02.834419    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:02.899391 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:02.899340    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:09.562686 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:09.562601    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:09.876114 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:09.876073    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:10.179884 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:10.179781    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:12.551455 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.551368    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:12.630411 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.630371    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"]
Jul 10 21:51:12.630738 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.630725    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerName="istio-proxy"
Jul 10 21:51:12.630777 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.630739    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bbb40b6-7d83-4074-b976-c87c79310ca9" containerName="istio-proxy"
Jul 10 21:51:12.630777 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.630749    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3b623e-b727-4819-8410-1887d0e5812e" containerName="maas-api"
Jul 10 21:51:12.630777 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.630755    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3b623e-b727-4819-8410-1887d0e5812e" containerName="maas-api"
Jul 10 21:51:12.630931 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.630822    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3b623e-b727-4819-8410-1887d0e5812e" containerName="maas-api"
Jul 10 21:51:12.633821 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.633797    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:12.637071 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.637048    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-acd5952a-serving-cert\""
Jul 10 21:51:12.637185 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.637168    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-r7zht\""
Jul 10 21:51:12.643906 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.643876    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:12.645758 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.645736    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"]
Jul 10 21:51:12.712886 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.712855    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:12.728061 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.728031    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddj5l\" (UniqueName: \"kubernetes.io/projected/5d706549-70b1-4196-ab6a-3405922d7507-kube-api-access-ddj5l\") pod \"maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz\" (UID: \"5d706549-70b1-4196-ab6a-3405922d7507\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:12.728196 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.728086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d706549-70b1-4196-ab6a-3405922d7507-openshift-service-ca\") pod \"maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz\" (UID: \"5d706549-70b1-4196-ab6a-3405922d7507\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:12.728196 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.728143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d706549-70b1-4196-ab6a-3405922d7507-maas-api-tls\") pod \"maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz\" (UID: \"5d706549-70b1-4196-ab6a-3405922d7507\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:12.813648 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.813555    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:12.829332 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.829307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddj5l\" (UniqueName: \"kubernetes.io/projected/5d706549-70b1-4196-ab6a-3405922d7507-kube-api-access-ddj5l\") pod \"maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz\" (UID: \"5d706549-70b1-4196-ab6a-3405922d7507\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:12.829496 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.829378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d706549-70b1-4196-ab6a-3405922d7507-openshift-service-ca\") pod \"maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz\" (UID: \"5d706549-70b1-4196-ab6a-3405922d7507\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:12.829496 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.829421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d706549-70b1-4196-ab6a-3405922d7507-maas-api-tls\") pod \"maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz\" (UID: \"5d706549-70b1-4196-ab6a-3405922d7507\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:12.830020 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.829997    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d706549-70b1-4196-ab6a-3405922d7507-openshift-service-ca\") pod \"maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz\" (UID: \"5d706549-70b1-4196-ab6a-3405922d7507\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:12.831914 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.831891    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d706549-70b1-4196-ab6a-3405922d7507-maas-api-tls\") pod \"maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz\" (UID: \"5d706549-70b1-4196-ab6a-3405922d7507\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:12.837124 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.837104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddj5l\" (UniqueName: \"kubernetes.io/projected/5d706549-70b1-4196-ab6a-3405922d7507-kube-api-access-ddj5l\") pod \"maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz\" (UID: \"5d706549-70b1-4196-ab6a-3405922d7507\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:12.946131 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:12.946094    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:13.084486 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:13.084453    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"]
Jul 10 21:51:13.086382 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:51:13.086356    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d706549_70b1_4196_ab6a_3405922d7507.slice/crio-d818c2b3e8d6469a67b6a05a191606e8e4f55d5dc47bf06c15d2229cfdeab940 WatchSource:0}: Error finding container d818c2b3e8d6469a67b6a05a191606e8e4f55d5dc47bf06c15d2229cfdeab940: Status 404 returned error can't find the container with id d818c2b3e8d6469a67b6a05a191606e8e4f55d5dc47bf06c15d2229cfdeab940
Jul 10 21:51:13.125104 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:13.125073    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:13.222828 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:13.222766    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:13.785548 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:13.785442    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz" event={"ID":"5d706549-70b1-4196-ab6a-3405922d7507","Type":"ContainerStarted","Data":"6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8"}
Jul 10 21:51:13.785982 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:13.785688    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:13.785982 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:13.785730    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz" event={"ID":"5d706549-70b1-4196-ab6a-3405922d7507","Type":"ContainerStarted","Data":"d818c2b3e8d6469a67b6a05a191606e8e4f55d5dc47bf06c15d2229cfdeab940"}
Jul 10 21:51:13.802229 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:13.802168    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz" podStartSLOduration=1.485049212 podStartE2EDuration="1.802151796s" totalImagesPullingTime="317.102584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:51:13.801642896 +0000 UTC m=+1799.434888152" watchObservedRunningTime="2026-07-10 21:51:13.802151796 +0000 UTC m=+1799.435397051"
Jul 10 21:51:15.591357 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:15.591330    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:51:15.595433 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:15.595408    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:51:15.604960 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:15.604936    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:51:16.038960 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:16.038877    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:16.139111 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:16.139075    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:17.061746 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:17.061713    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:19.795726 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:19.795697    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:51:32.097774 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.097716    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"]
Jul 10 21:51:32.101298 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.101262    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.103846 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.103826    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-acd5952a\"/\"openshift-service-ca.crt\""
Jul 10 21:51:32.103979 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.103916    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-acd5952a\"/\"kube-root-ca.crt\""
Jul 10 21:51:32.104666 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.104650    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-acd5952a\"/\"default-dockercfg-z6tmg\""
Jul 10 21:51:32.104976 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.104962    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-acd5952a\"/\"e2e-lifecycle-model-acd5952a-kserve-self-signed-certs\""
Jul 10 21:51:32.110433 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.110408    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"]
Jul 10 21:51:32.118800 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.118760    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:51:32.189672 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.189629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c97b4e-5640-44dc-9160-02f2ab0688a8-tls-certs\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.189860 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.189690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-dshm\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.189860 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.189724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-home\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.189860 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.189761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-model-cache\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.189860 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.189836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2ndj\" (UniqueName: \"kubernetes.io/projected/57c97b4e-5640-44dc-9160-02f2ab0688a8-kube-api-access-m2ndj\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.190018 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.189893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-tmp-dir\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.291005 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.290958    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-tmp-dir\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.291193 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.291017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c97b4e-5640-44dc-9160-02f2ab0688a8-tls-certs\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.291193 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.291050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-dshm\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.291193 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.291073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-home\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.291193 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.291101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-model-cache\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.291430 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.291247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2ndj\" (UniqueName: \"kubernetes.io/projected/57c97b4e-5640-44dc-9160-02f2ab0688a8-kube-api-access-m2ndj\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.291493 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.291470    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-tmp-dir\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.291546 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.291517    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-home\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.291598 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.291553    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-model-cache\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.293495 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.293476    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-dshm\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.293623 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.293607    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c97b4e-5640-44dc-9160-02f2ab0688a8-tls-certs\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.300180 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.300149    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2ndj\" (UniqueName: \"kubernetes.io/projected/57c97b4e-5640-44dc-9160-02f2ab0688a8-kube-api-access-m2ndj\") pod \"e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") " pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.411012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.410915    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:32.545120 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.545085    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"]
Jul 10 21:51:32.558046 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:51:32.558018    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57c97b4e_5640_44dc_9160_02f2ab0688a8.slice/crio-663607dec641a8e5315f59db45d7505f231b187bd831a95a2c46d9f7ad725e1f WatchSource:0}: Error finding container 663607dec641a8e5315f59db45d7505f231b187bd831a95a2c46d9f7ad725e1f: Status 404 returned error can't find the container with id 663607dec641a8e5315f59db45d7505f231b187bd831a95a2c46d9f7ad725e1f
Jul 10 21:51:32.898649 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.898612    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk" event={"ID":"57c97b4e-5640-44dc-9160-02f2ab0688a8","Type":"ContainerStarted","Data":"5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3"}
Jul 10 21:51:32.898819 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.898662    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk" event={"ID":"57c97b4e-5640-44dc-9160-02f2ab0688a8","Type":"ContainerStarted","Data":"663607dec641a8e5315f59db45d7505f231b187bd831a95a2c46d9f7ad725e1f"}
Jul 10 21:51:32.917662 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:32.917607    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk" podStartSLOduration=0.91759239 podStartE2EDuration="917.59239ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:51:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:51:32.915115831 +0000 UTC m=+1818.548361080" watchObservedRunningTime="2026-07-10 21:51:32.91759239 +0000 UTC m=+1818.550837637"
Jul 10 21:51:36.089083 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:36.089044    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:51:42.412175 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:42.412140    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:42.412762 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:42.412193    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:42.424894 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:42.424868    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:42.967888 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:42.967860    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:51:48.099439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:51:48.099403    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:52:05.637265 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:05.637215    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"]
Jul 10 21:52:05.637766 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:05.637500    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz" podUID="5d706549-70b1-4196-ab6a-3405922d7507" containerName="maas-api" containerID="cri-o://6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8" gracePeriod=30
Jul 10 21:52:05.665996 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:05.665966    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:52:05.896091 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:05.896026    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:52:05.993002 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:05.992965    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d706549-70b1-4196-ab6a-3405922d7507-openshift-service-ca\") pod \"5d706549-70b1-4196-ab6a-3405922d7507\" (UID: \"5d706549-70b1-4196-ab6a-3405922d7507\") "
Jul 10 21:52:05.993002 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:05.993009    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d706549-70b1-4196-ab6a-3405922d7507-maas-api-tls\") pod \"5d706549-70b1-4196-ab6a-3405922d7507\" (UID: \"5d706549-70b1-4196-ab6a-3405922d7507\") "
Jul 10 21:52:05.993320 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:05.993106    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddj5l\" (UniqueName: \"kubernetes.io/projected/5d706549-70b1-4196-ab6a-3405922d7507-kube-api-access-ddj5l\") pod \"5d706549-70b1-4196-ab6a-3405922d7507\" (UID: \"5d706549-70b1-4196-ab6a-3405922d7507\") "
Jul 10 21:52:05.993474 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:05.993450    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d706549-70b1-4196-ab6a-3405922d7507-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5d706549-70b1-4196-ab6a-3405922d7507" (UID: "5d706549-70b1-4196-ab6a-3405922d7507"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:52:05.995247 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:05.995221    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d706549-70b1-4196-ab6a-3405922d7507-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5d706549-70b1-4196-ab6a-3405922d7507" (UID: "5d706549-70b1-4196-ab6a-3405922d7507"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:52:05.995375 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:05.995352    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d706549-70b1-4196-ab6a-3405922d7507-kube-api-access-ddj5l" (OuterVolumeSpecName: "kube-api-access-ddj5l") pod "5d706549-70b1-4196-ab6a-3405922d7507" (UID: "5d706549-70b1-4196-ab6a-3405922d7507"). InnerVolumeSpecName "kube-api-access-ddj5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:52:06.076804 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:06.076771    2575 generic.go:356] "Generic (PLEG): container finished" podID="5d706549-70b1-4196-ab6a-3405922d7507" containerID="6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8" exitCode=0
Jul 10 21:52:06.077010 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:06.076819    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"
Jul 10 21:52:06.077010 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:06.076864    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz" event={"ID":"5d706549-70b1-4196-ab6a-3405922d7507","Type":"ContainerDied","Data":"6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8"}
Jul 10 21:52:06.077010 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:06.076951    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz" event={"ID":"5d706549-70b1-4196-ab6a-3405922d7507","Type":"ContainerDied","Data":"d818c2b3e8d6469a67b6a05a191606e8e4f55d5dc47bf06c15d2229cfdeab940"}
Jul 10 21:52:06.077010 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:06.076983    2575 scope.go:117] "RemoveContainer" containerID="6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8"
Jul 10 21:52:06.086929 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:06.086904    2575 scope.go:117] "RemoveContainer" containerID="6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8"
Jul 10 21:52:06.087213 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:52:06.087195    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8\": container with ID starting with 6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8 not found: ID does not exist" containerID="6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8"
Jul 10 21:52:06.087295 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:06.087226    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8"} err="failed to get container status \"6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8\": rpc error: code = NotFound desc = could not find container \"6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8\": container with ID starting with 6599797d0f06d3dc5051c5f7128f4ab6018beff3297c3522844d62f8c6d999a8 not found: ID does not exist"
Jul 10 21:52:06.094189 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:06.094165    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddj5l\" (UniqueName: \"kubernetes.io/projected/5d706549-70b1-4196-ab6a-3405922d7507-kube-api-access-ddj5l\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:52:06.094189 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:06.094187    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d706549-70b1-4196-ab6a-3405922d7507-openshift-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:52:06.094365 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:06.094197    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d706549-70b1-4196-ab6a-3405922d7507-maas-api-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:52:06.098516 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:06.098490    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"]
Jul 10 21:52:06.102618 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:06.102595    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-acd5952a-745b7fdd5d-9s4kz"]
Jul 10 21:52:07.523349 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:07.523317    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d706549-70b1-4196-ab6a-3405922d7507" path="/var/lib/kubelet/pods/5d706549-70b1-4196-ab6a-3405922d7507/volumes"
Jul 10 21:52:08.995641 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:08.995602    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:52:10.316103 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:10.316063    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:52:15.297012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:15.296974    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"]
Jul 10 21:52:15.393127 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:15.393079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:52:30.317790 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.317733    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk" podUID="57c97b4e-5640-44dc-9160-02f2ab0688a8" containerName="main" containerID="cri-o://5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3" gracePeriod=45
Jul 10 21:52:30.565751 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.565724    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:52:30.598916 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.598887    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2ndj\" (UniqueName: \"kubernetes.io/projected/57c97b4e-5640-44dc-9160-02f2ab0688a8-kube-api-access-m2ndj\") pod \"57c97b4e-5640-44dc-9160-02f2ab0688a8\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") "
Jul 10 21:52:30.599100 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.598926    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-tmp-dir\") pod \"57c97b4e-5640-44dc-9160-02f2ab0688a8\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") "
Jul 10 21:52:30.599100 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.598962    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-home\") pod \"57c97b4e-5640-44dc-9160-02f2ab0688a8\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") "
Jul 10 21:52:30.599100 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.598987    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-dshm\") pod \"57c97b4e-5640-44dc-9160-02f2ab0688a8\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") "
Jul 10 21:52:30.599100 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.599016    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-model-cache\") pod \"57c97b4e-5640-44dc-9160-02f2ab0688a8\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") "
Jul 10 21:52:30.599100 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.599035    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c97b4e-5640-44dc-9160-02f2ab0688a8-tls-certs\") pod \"57c97b4e-5640-44dc-9160-02f2ab0688a8\" (UID: \"57c97b4e-5640-44dc-9160-02f2ab0688a8\") "
Jul 10 21:52:30.599403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.599320    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-home" (OuterVolumeSpecName: "home") pod "57c97b4e-5640-44dc-9160-02f2ab0688a8" (UID: "57c97b4e-5640-44dc-9160-02f2ab0688a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:52:30.599403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.599335    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "57c97b4e-5640-44dc-9160-02f2ab0688a8" (UID: "57c97b4e-5640-44dc-9160-02f2ab0688a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:52:30.599559 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.599534    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57c97b4e-5640-44dc-9160-02f2ab0688a8" (UID: "57c97b4e-5640-44dc-9160-02f2ab0688a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:52:30.601353 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.601319    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c97b4e-5640-44dc-9160-02f2ab0688a8-kube-api-access-m2ndj" (OuterVolumeSpecName: "kube-api-access-m2ndj") pod "57c97b4e-5640-44dc-9160-02f2ab0688a8" (UID: "57c97b4e-5640-44dc-9160-02f2ab0688a8"). InnerVolumeSpecName "kube-api-access-m2ndj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:52:30.601478 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.601350    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-dshm" (OuterVolumeSpecName: "dshm") pod "57c97b4e-5640-44dc-9160-02f2ab0688a8" (UID: "57c97b4e-5640-44dc-9160-02f2ab0688a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:52:30.601576 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.601554    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c97b4e-5640-44dc-9160-02f2ab0688a8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57c97b4e-5640-44dc-9160-02f2ab0688a8" (UID: "57c97b4e-5640-44dc-9160-02f2ab0688a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:52:30.700199 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.700162    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2ndj\" (UniqueName: \"kubernetes.io/projected/57c97b4e-5640-44dc-9160-02f2ab0688a8-kube-api-access-m2ndj\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:52:30.700199 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.700193    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-tmp-dir\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:52:30.700199 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.700204    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-home\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:52:30.700199 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.700212    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-dshm\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:52:30.700494 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.700220    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c97b4e-5640-44dc-9160-02f2ab0688a8-model-cache\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:52:30.700494 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:30.700228    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c97b4e-5640-44dc-9160-02f2ab0688a8-tls-certs\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:52:31.206964 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:31.206928    2575 generic.go:356] "Generic (PLEG): container finished" podID="57c97b4e-5640-44dc-9160-02f2ab0688a8" containerID="5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3" exitCode=0
Jul 10 21:52:31.207151 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:31.206988    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"
Jul 10 21:52:31.207151 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:31.207001    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk" event={"ID":"57c97b4e-5640-44dc-9160-02f2ab0688a8","Type":"ContainerDied","Data":"5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3"}
Jul 10 21:52:31.207151 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:31.207048    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk" event={"ID":"57c97b4e-5640-44dc-9160-02f2ab0688a8","Type":"ContainerDied","Data":"663607dec641a8e5315f59db45d7505f231b187bd831a95a2c46d9f7ad725e1f"}
Jul 10 21:52:31.207151 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:31.207066    2575 scope.go:117] "RemoveContainer" containerID="5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3"
Jul 10 21:52:31.216330 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:31.216310    2575 scope.go:117] "RemoveContainer" containerID="5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3"
Jul 10 21:52:31.216602 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:52:31.216585    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3\": container with ID starting with 5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3 not found: ID does not exist" containerID="5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3"
Jul 10 21:52:31.216668 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:31.216612    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3"} err="failed to get container status \"5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3\": rpc error: code = NotFound desc = could not find container \"5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3\": container with ID starting with 5eb9aa8525446eaa5cc70ddefa85d67598d6533f29beba2aa3254959836934c3 not found: ID does not exist"
Jul 10 21:52:31.227857 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:31.227830    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"]
Jul 10 21:52:31.234211 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:31.234185    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-acd5952a/e2e-lifecycle-model-acd5952a-kserve-7ddb8d6f9f-rc7hk"]
Jul 10 21:52:31.523692 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:31.523594    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57c97b4e-5640-44dc-9160-02f2ab0688a8" path="/var/lib/kubelet/pods/57c97b4e-5640-44dc-9160-02f2ab0688a8/volumes"
Jul 10 21:52:32.474101 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:32.474060    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:52:32.523721 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:32.523689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:52:52.163140 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:52.163060    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:52:52.486965 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:52.486883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:52:58.033750 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:58.033714    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:52:58.093549 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:52:58.093515    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:02.618574 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:02.618534    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:02.850863 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:02.850824    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:03.914536 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:03.914492    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:04.014173 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:04.014130    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:04.114244 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:04.114212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:04.858835 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:04.858798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:04.955841 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:04.955806    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:05.060766 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:05.060720    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:06.467947 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:06.467910    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:07.000690 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:07.000657    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:53:12.237917 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:12.237882    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:12.303609 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:12.303579    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:12.929443 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:12.929406    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:15.988744 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:15.988639    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:16.087354 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:16.087317    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:18.626685 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:18.626649    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:18.805906 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:18.805873    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:53:19.634357 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:19.634322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:29.396218 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:29.396183    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:29.770020 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:29.769927    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:50.735220 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:50.735184    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:56.374086 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:56.374039    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:56.430917 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:56.430882    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:56.792196 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:56.792089    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:57.114865 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:57.114830    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:53:57.245785 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:53:57.245748    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:00.586954 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.586899    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:00.680231 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.680190    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:00.686262 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.686232    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"]
Jul 10 21:54:00.686998 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.686975    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c97b4e-5640-44dc-9160-02f2ab0688a8" containerName="main"
Jul 10 21:54:00.686998 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.686998    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c97b4e-5640-44dc-9160-02f2ab0688a8" containerName="main"
Jul 10 21:54:00.687134 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.687019    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d706549-70b1-4196-ab6a-3405922d7507" containerName="maas-api"
Jul 10 21:54:00.687134 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.687028    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d706549-70b1-4196-ab6a-3405922d7507" containerName="maas-api"
Jul 10 21:54:00.687134 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.687125    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d706549-70b1-4196-ab6a-3405922d7507" containerName="maas-api"
Jul 10 21:54:00.687225 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.687142    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c97b4e-5640-44dc-9160-02f2ab0688a8" containerName="main"
Jul 10 21:54:00.690345 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.690325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:00.694201 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.694182    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-r7zht\""
Jul 10 21:54:00.694453 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.694432    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-0b0348-serving-cert\""
Jul 10 21:54:00.701312 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.701242    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"]
Jul 10 21:54:00.760362 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.760327    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:00.767665 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.767637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93206766-2422-4325-97bd-762340372998-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z\" (UID: \"93206766-2422-4325-97bd-762340372998\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:00.767776 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.767678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93206766-2422-4325-97bd-762340372998-maas-api-tls\") pod \"maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z\" (UID: \"93206766-2422-4325-97bd-762340372998\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:00.767776 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.767736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x6s4\" (UniqueName: \"kubernetes.io/projected/93206766-2422-4325-97bd-762340372998-kube-api-access-8x6s4\") pod \"maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z\" (UID: \"93206766-2422-4325-97bd-762340372998\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:00.869168 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.869075    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93206766-2422-4325-97bd-762340372998-maas-api-tls\") pod \"maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z\" (UID: \"93206766-2422-4325-97bd-762340372998\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:00.869168 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.869148    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x6s4\" (UniqueName: \"kubernetes.io/projected/93206766-2422-4325-97bd-762340372998-kube-api-access-8x6s4\") pod \"maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z\" (UID: \"93206766-2422-4325-97bd-762340372998\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:00.869430 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.869231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93206766-2422-4325-97bd-762340372998-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z\" (UID: \"93206766-2422-4325-97bd-762340372998\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:00.869937 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.869914    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93206766-2422-4325-97bd-762340372998-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z\" (UID: \"93206766-2422-4325-97bd-762340372998\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:00.871616 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.871596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93206766-2422-4325-97bd-762340372998-maas-api-tls\") pod \"maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z\" (UID: \"93206766-2422-4325-97bd-762340372998\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:00.891787 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.891753    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x6s4\" (UniqueName: \"kubernetes.io/projected/93206766-2422-4325-97bd-762340372998-kube-api-access-8x6s4\") pod \"maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z\" (UID: \"93206766-2422-4325-97bd-762340372998\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:00.942675 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:00.942631    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:01.002540 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:01.002494    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:01.139080 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:01.139046    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"]
Jul 10 21:54:01.140946 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:54:01.140915    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93206766_2422_4325_97bd_762340372998.slice/crio-5a3d21aa831e0ba2afaf57f30cbc13507c568727cdcdc1a8cabf9550a6e62149 WatchSource:0}: Error finding container 5a3d21aa831e0ba2afaf57f30cbc13507c568727cdcdc1a8cabf9550a6e62149: Status 404 returned error can't find the container with id 5a3d21aa831e0ba2afaf57f30cbc13507c568727cdcdc1a8cabf9550a6e62149
Jul 10 21:54:01.243160 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:01.242883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:01.343635 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:01.343594    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:01.693344 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:01.693300    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z" event={"ID":"93206766-2422-4325-97bd-762340372998","Type":"ContainerStarted","Data":"6bc122a88bf47fe930b4cdd37810d1ec4f5db7f8d665d10e645719b549a2f864"}
Jul 10 21:54:01.693813 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:01.693386    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z" event={"ID":"93206766-2422-4325-97bd-762340372998","Type":"ContainerStarted","Data":"5a3d21aa831e0ba2afaf57f30cbc13507c568727cdcdc1a8cabf9550a6e62149"}
Jul 10 21:54:01.693813 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:01.693420    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:01.711442 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:01.711387    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z" podStartSLOduration=1.296132337 podStartE2EDuration="1.711368222s" totalImagesPullingTime="415.235885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:54:01.710974734 +0000 UTC m=+1967.344219989" watchObservedRunningTime="2026-07-10 21:54:01.711368222 +0000 UTC m=+1967.344613475"
Jul 10 21:54:04.717868 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:04.717821    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:05.187251 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:05.187220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:05.571327 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:05.571219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:05.885525 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:05.885489    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"]
Jul 10 21:54:05.889575 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:05.889550    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:05.892022 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:05.891989    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-7d633a-openshift-default-dockercfg-sxdjf\""
Jul 10 21:54:05.901933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:05.901907    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"]
Jul 10 21:54:05.918011 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:05.917981    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:06.013704 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.013662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-token\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.013704 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.013706    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zrbf\" (UniqueName: \"kubernetes.io/projected/844b2afd-7faf-4017-870c-a4cbb2c1c2de-kube-api-access-9zrbf\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.013958 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.013748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istiod-ca-cert\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.013958 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.013789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-envoy\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.013958 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.013815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-data\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.013958 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.013840    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-credential-socket\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.013958 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.013865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-podinfo\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.014152 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.013968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-workload-socket\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.014152 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.013997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-workload-certs\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.114705 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.114624    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-workload-socket\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.114705 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.114660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-workload-certs\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.114939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.114849    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-token\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.114939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.114882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zrbf\" (UniqueName: \"kubernetes.io/projected/844b2afd-7faf-4017-870c-a4cbb2c1c2de-kube-api-access-9zrbf\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.114939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.114927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istiod-ca-cert\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.115104 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.114963    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-envoy\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.115104 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.114989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-data\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.115104 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.115013    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-credential-socket\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.115104 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.115044    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-podinfo\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.115104 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.115076    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-workload-socket\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.115483 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.115461    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-data\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.115547 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.115477    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-workload-certs\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.115601 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.115549    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-credential-socket\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.115853 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.115832    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istiod-ca-cert\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.117345 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.117326    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-envoy\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.117750 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.117732    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-podinfo\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.122773 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.122751    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-token\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.122892 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.122870    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zrbf\" (UniqueName: \"kubernetes.io/projected/844b2afd-7faf-4017-870c-a4cbb2c1c2de-kube-api-access-9zrbf\") pod \"e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") " pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.201879 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.201785    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:06.345546 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.345522    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"]
Jul 10 21:54:06.346804 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:54:06.346776    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod844b2afd_7faf_4017_870c_a4cbb2c1c2de.slice/crio-93cda0ac539e8e4758ff7a0e42c61d80476e0ccd9c22d1241117e9c0a02d4b11 WatchSource:0}: Error finding container 93cda0ac539e8e4758ff7a0e42c61d80476e0ccd9c22d1241117e9c0a02d4b11: Status 404 returned error can't find the container with id 93cda0ac539e8e4758ff7a0e42c61d80476e0ccd9c22d1241117e9c0a02d4b11
Jul 10 21:54:06.348879 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.348849    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:54:06.348954 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.348914    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:54:06.348954 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.348941    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:54:06.407750 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.407719    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:06.722912 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.722879    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" event={"ID":"844b2afd-7faf-4017-870c-a4cbb2c1c2de","Type":"ContainerStarted","Data":"e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0"}
Jul 10 21:54:06.723098 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.722930    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" event={"ID":"844b2afd-7faf-4017-870c-a4cbb2c1c2de","Type":"ContainerStarted","Data":"93cda0ac539e8e4758ff7a0e42c61d80476e0ccd9c22d1241117e9c0a02d4b11"}
Jul 10 21:54:06.744322 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:06.744254    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" podStartSLOduration=1.74423745 podStartE2EDuration="1.74423745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:54:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:54:06.742345779 +0000 UTC m=+1972.375591033" watchObservedRunningTime="2026-07-10 21:54:06.74423745 +0000 UTC m=+1972.377482703"
Jul 10 21:54:07.202847 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:07.202805    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:07.207813 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:07.207785    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:07.706744 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:07.706717    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:54:07.728113 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:07.728083    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:07.729067 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:07.729044    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:07.797497 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:07.797466    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:54:08.881656 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:08.881620    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:08.987527 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:08.987493    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:09.014958 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.014924    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"]
Jul 10 21:54:09.019088 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.019062    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:09.021573 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.021550    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-7d633a-serving-cert\""
Jul 10 21:54:09.029037 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.028796    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"]
Jul 10 21:54:09.087004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.086972    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:09.142253 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.142169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz\" (UID: \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:09.142253 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.142212    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-maas-api-tls\") pod \"maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz\" (UID: \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:09.142253 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.142238    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95gng\" (UniqueName: \"kubernetes.io/projected/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-kube-api-access-95gng\") pod \"maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz\" (UID: \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:09.191722 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.191692    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:09.243433 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.243397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-maas-api-tls\") pod \"maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz\" (UID: \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:09.243433 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.243440    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95gng\" (UniqueName: \"kubernetes.io/projected/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-kube-api-access-95gng\") pod \"maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz\" (UID: \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:09.243684 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.243516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz\" (UID: \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:09.244147 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.244124    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz\" (UID: \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:09.245936 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.245912    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-maas-api-tls\") pod \"maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz\" (UID: \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:09.251590 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.251564    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95gng\" (UniqueName: \"kubernetes.io/projected/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-kube-api-access-95gng\") pod \"maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz\" (UID: \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:09.333767 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.333733    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:09.481411 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.481382    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"]
Jul 10 21:54:09.483624 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:54:09.483561    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6cf5b0b_305c_4e58_afe6_b5779f62a62e.slice/crio-805929f61e19766c893470a16ae85a20e57825d5c8d47a26fa927089f4e7cc3a WatchSource:0}: Error finding container 805929f61e19766c893470a16ae85a20e57825d5c8d47a26fa927089f4e7cc3a: Status 404 returned error can't find the container with id 805929f61e19766c893470a16ae85a20e57825d5c8d47a26fa927089f4e7cc3a
Jul 10 21:54:09.584996 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.584950    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:09.686034 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.685935    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:09.741717 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:09.741683    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz" event={"ID":"e6cf5b0b-305c-4e58-afe6-b5779f62a62e","Type":"ContainerStarted","Data":"805929f61e19766c893470a16ae85a20e57825d5c8d47a26fa927089f4e7cc3a"}
Jul 10 21:54:10.748296 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:10.748239    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz" event={"ID":"e6cf5b0b-305c-4e58-afe6-b5779f62a62e","Type":"ContainerStarted","Data":"e2eef65b253d1c0c7ef1cdb50595a91950c9edeb976e54245e645bdc0a6be501"}
Jul 10 21:54:10.748711 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:10.748388    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:10.769086 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:10.769034    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz" podStartSLOduration=2.406147867 podStartE2EDuration="2.769014443s" totalImagesPullingTime="362.866576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:54:10.768440912 +0000 UTC m=+1976.401686164" watchObservedRunningTime="2026-07-10 21:54:10.769014443 +0000 UTC m=+1976.402259696"
Jul 10 21:54:13.573390 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:13.573355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:16.762366 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:16.762336    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:54:19.302430 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:19.302395    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:54:22.816721 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:22.816669    2575 patch_prober.go:28] interesting pod/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:37064->10.133.0.59:15021: read: connection reset by peer" start-of-body=
Jul 10 21:54:22.817173 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:22.816753    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:37064->10.133.0.59:15021: read: connection reset by peer"
Jul 10 21:54:23.065776 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:23.065664    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:23.165289 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:23.165234    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:23.822345 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:23.822309    2575 generic.go:356] "Generic (PLEG): container finished" podID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerID="e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0" exitCode=0
Jul 10 21:54:23.822728 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:23.822382    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" event={"ID":"844b2afd-7faf-4017-870c-a4cbb2c1c2de","Type":"ContainerDied","Data":"e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0"}
Jul 10 21:54:23.822794 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:23.822780    2575 scope.go:117] "RemoveContainer" containerID="e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0"
Jul 10 21:54:23.823909 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:23.823883    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:54:23.823971 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:23.823948    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:54:23.824006 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:23.823998    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:54:24.829573 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:24.829534    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" event={"ID":"844b2afd-7faf-4017-870c-a4cbb2c1c2de","Type":"ContainerStarted","Data":"702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e"}
Jul 10 21:54:25.202653 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:25.202564    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:25.202828 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:25.202799    2575 patch_prober.go:28] interesting pod/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 10 21:54:25.202903 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:25.202859    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 10 21:54:26.202974 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:26.202934    2575 patch_prober.go:28] interesting pod/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 10 21:54:26.203373 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:26.202991    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 10 21:54:27.202361 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:27.202318    2575 patch_prober.go:28] interesting pod/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 10 21:54:27.202556 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:27.202379    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 10 21:54:28.202265 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:28.202229    2575 patch_prober.go:28] interesting pod/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 10 21:54:28.202697 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:28.202309    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 10 21:54:29.202530 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:29.202492    2575 patch_prober.go:28] interesting pod/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 10 21:54:29.202950 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:29.202554    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 10 21:54:30.206749 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:30.206698    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:30.207240 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:30.207223    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:30.207808 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:30.207788    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:54:30.309869 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:30.309834    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:30.411910 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:30.411878    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:36.713801 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:36.713765    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:54:40.194412 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:40.194371    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:54:51.901302 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:54:51.901242    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:55:12.594293 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.594242    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"]
Jul 10 21:55:12.597325 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.597307    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.599969 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.599946    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7d633a\"/\"kube-root-ca.crt\""
Jul 10 21:55:12.600105 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.599946    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7d633a\"/\"openshift-service-ca.crt\""
Jul 10 21:55:12.600992 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.600974    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7d633a\"/\"default-dockercfg-w2sr6\""
Jul 10 21:55:12.601118 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.601006    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7d633a\"/\"test-model-7d633a-kserve-self-signed-certs\""
Jul 10 21:55:12.608044 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.608017    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"]
Jul 10 21:55:12.627675 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.627638    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:55:12.728221 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.728171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-tmp-dir\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.728430 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.728237    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e094ff10-2a41-46f0-a4d8-1769d585beb1-tls-certs\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.728430 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.728304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-home\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.728430 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.728358    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-dshm\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.728430 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.728404    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-model-cache\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.728430 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.728427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75h6m\" (UniqueName: \"kubernetes.io/projected/e094ff10-2a41-46f0-a4d8-1769d585beb1-kube-api-access-75h6m\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.829621 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.829586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-dshm\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.829802 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.829643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-model-cache\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.829802 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.829672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75h6m\" (UniqueName: \"kubernetes.io/projected/e094ff10-2a41-46f0-a4d8-1769d585beb1-kube-api-access-75h6m\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.829802 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.829735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-tmp-dir\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.829802 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.829785    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e094ff10-2a41-46f0-a4d8-1769d585beb1-tls-certs\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.830020 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.829813    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-home\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.830153 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.830130    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-model-cache\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.830216 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.830149    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-tmp-dir\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.830216 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.830190    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-home\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.832004 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.831979    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-dshm\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.832175 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.832158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e094ff10-2a41-46f0-a4d8-1769d585beb1-tls-certs\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.838629 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.838609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75h6m\" (UniqueName: \"kubernetes.io/projected/e094ff10-2a41-46f0-a4d8-1769d585beb1-kube-api-access-75h6m\") pod \"test-model-7d633a-kserve-5984fc769-v8hzh\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") " pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:12.907916 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:12.907837    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:13.041190 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:13.041167    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"]
Jul 10 21:55:13.042798 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:55:13.042771    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode094ff10_2a41_46f0_a4d8_1769d585beb1.slice/crio-a9e6c83a3a712f0a7223c61f137715b19cdae4060f6546c388760d381b23fe0c WatchSource:0}: Error finding container a9e6c83a3a712f0a7223c61f137715b19cdae4060f6546c388760d381b23fe0c: Status 404 returned error can't find the container with id a9e6c83a3a712f0a7223c61f137715b19cdae4060f6546c388760d381b23fe0c
Jul 10 21:55:13.112352 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:13.112315    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh" event={"ID":"e094ff10-2a41-46f0-a4d8-1769d585beb1","Type":"ContainerStarted","Data":"c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b"}
Jul 10 21:55:13.112524 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:13.112362    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh" event={"ID":"e094ff10-2a41-46f0-a4d8-1769d585beb1","Type":"ContainerStarted","Data":"a9e6c83a3a712f0a7223c61f137715b19cdae4060f6546c388760d381b23fe0c"}
Jul 10 21:55:13.129158 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:13.129096    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh" podStartSLOduration=1.12907214 podStartE2EDuration="1.12907214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:55:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:55:13.128018093 +0000 UTC m=+2038.761263348" watchObservedRunningTime="2026-07-10 21:55:13.12907214 +0000 UTC m=+2038.762317397"
Jul 10 21:55:16.603025 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:16.602989    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:55:22.907945 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:22.907915    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:22.908419 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:22.907959    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:22.920445 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:22.920415    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:23.179553 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:23.179463    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:55:30.690859 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:30.690818    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:55:44.329796 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:44.329704    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:55:53.621078 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:53.621037    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:55:54.552567 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:54.552535    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"]
Jul 10 21:55:54.574165 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:54.574116    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:55:55.380316 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:55.380246    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:55:55.482665 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:55.482627    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:55:58.700552 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:55:58.700517    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:56:05.148708 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.148667    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"]
Jul 10 21:56:05.149181 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.148962    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z" podUID="93206766-2422-4325-97bd-762340372998" containerName="maas-api" containerID="cri-o://6bc122a88bf47fe930b4cdd37810d1ec4f5db7f8d665d10e645719b549a2f864" gracePeriod=30
Jul 10 21:56:05.180228 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.180198    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:05.401829 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.401796    2575 generic.go:356] "Generic (PLEG): container finished" podID="93206766-2422-4325-97bd-762340372998" containerID="6bc122a88bf47fe930b4cdd37810d1ec4f5db7f8d665d10e645719b549a2f864" exitCode=0
Jul 10 21:56:05.401975 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.401878    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z" event={"ID":"93206766-2422-4325-97bd-762340372998","Type":"ContainerDied","Data":"6bc122a88bf47fe930b4cdd37810d1ec4f5db7f8d665d10e645719b549a2f864"}
Jul 10 21:56:05.401975 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.401934    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z" event={"ID":"93206766-2422-4325-97bd-762340372998","Type":"ContainerDied","Data":"5a3d21aa831e0ba2afaf57f30cbc13507c568727cdcdc1a8cabf9550a6e62149"}
Jul 10 21:56:05.401975 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.401951    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a3d21aa831e0ba2afaf57f30cbc13507c568727cdcdc1a8cabf9550a6e62149"
Jul 10 21:56:05.416255 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.416225    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:56:05.514604 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.514570    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x6s4\" (UniqueName: \"kubernetes.io/projected/93206766-2422-4325-97bd-762340372998-kube-api-access-8x6s4\") pod \"93206766-2422-4325-97bd-762340372998\" (UID: \"93206766-2422-4325-97bd-762340372998\") "
Jul 10 21:56:05.514775 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.514622    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93206766-2422-4325-97bd-762340372998-maas-api-tls\") pod \"93206766-2422-4325-97bd-762340372998\" (UID: \"93206766-2422-4325-97bd-762340372998\") "
Jul 10 21:56:05.514775 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.514663    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93206766-2422-4325-97bd-762340372998-openshift-service-ca\") pod \"93206766-2422-4325-97bd-762340372998\" (UID: \"93206766-2422-4325-97bd-762340372998\") "
Jul 10 21:56:05.515091 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.515061    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93206766-2422-4325-97bd-762340372998-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93206766-2422-4325-97bd-762340372998" (UID: "93206766-2422-4325-97bd-762340372998"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:56:05.516681 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.516655    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93206766-2422-4325-97bd-762340372998-kube-api-access-8x6s4" (OuterVolumeSpecName: "kube-api-access-8x6s4") pod "93206766-2422-4325-97bd-762340372998" (UID: "93206766-2422-4325-97bd-762340372998"). InnerVolumeSpecName "kube-api-access-8x6s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:56:05.516786 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.516710    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93206766-2422-4325-97bd-762340372998-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93206766-2422-4325-97bd-762340372998" (UID: "93206766-2422-4325-97bd-762340372998"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:56:05.616253 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.616221    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x6s4\" (UniqueName: \"kubernetes.io/projected/93206766-2422-4325-97bd-762340372998-kube-api-access-8x6s4\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:05.616253 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.616250    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93206766-2422-4325-97bd-762340372998-maas-api-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:05.616253 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:05.616260    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93206766-2422-4325-97bd-762340372998-openshift-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:06.407161 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:06.407131    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"
Jul 10 21:56:06.425117 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:06.425086    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"]
Jul 10 21:56:06.428606 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:06.428578    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0348-5d75879bf-tjz9z"]
Jul 10 21:56:07.529761 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:07.529725    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93206766-2422-4325-97bd-762340372998" path="/var/lib/kubelet/pods/93206766-2422-4325-97bd-762340372998/volumes"
Jul 10 21:56:09.572541 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.572485    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh" podUID="e094ff10-2a41-46f0-a4d8-1769d585beb1" containerName="main" containerID="cri-o://c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b" gracePeriod=45
Jul 10 21:56:09.813904 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.813842    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:09.828630 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.828571    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:56:09.854816 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.854776    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-model-cache\") pod \"e094ff10-2a41-46f0-a4d8-1769d585beb1\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") "
Jul 10 21:56:09.854993 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.854853    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e094ff10-2a41-46f0-a4d8-1769d585beb1-tls-certs\") pod \"e094ff10-2a41-46f0-a4d8-1769d585beb1\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") "
Jul 10 21:56:09.854993 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.854906    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75h6m\" (UniqueName: \"kubernetes.io/projected/e094ff10-2a41-46f0-a4d8-1769d585beb1-kube-api-access-75h6m\") pod \"e094ff10-2a41-46f0-a4d8-1769d585beb1\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") "
Jul 10 21:56:09.854993 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.854938    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-tmp-dir\") pod \"e094ff10-2a41-46f0-a4d8-1769d585beb1\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") "
Jul 10 21:56:09.854993 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.854961    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-home\") pod \"e094ff10-2a41-46f0-a4d8-1769d585beb1\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") "
Jul 10 21:56:09.854993 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.854985    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-dshm\") pod \"e094ff10-2a41-46f0-a4d8-1769d585beb1\" (UID: \"e094ff10-2a41-46f0-a4d8-1769d585beb1\") "
Jul 10 21:56:09.855290 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.855047    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-model-cache" (OuterVolumeSpecName: "model-cache") pod "e094ff10-2a41-46f0-a4d8-1769d585beb1" (UID: "e094ff10-2a41-46f0-a4d8-1769d585beb1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:56:09.855290 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.855183    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e094ff10-2a41-46f0-a4d8-1769d585beb1" (UID: "e094ff10-2a41-46f0-a4d8-1769d585beb1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:56:09.855402 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.855265    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-home" (OuterVolumeSpecName: "home") pod "e094ff10-2a41-46f0-a4d8-1769d585beb1" (UID: "e094ff10-2a41-46f0-a4d8-1769d585beb1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:56:09.855402 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.855389    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-model-cache\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:09.855512 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.855415    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-tmp-dir\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:09.855512 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.855431    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-home\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:09.857158 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.857132    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e094ff10-2a41-46f0-a4d8-1769d585beb1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e094ff10-2a41-46f0-a4d8-1769d585beb1" (UID: "e094ff10-2a41-46f0-a4d8-1769d585beb1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:56:09.857322 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.857171    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e094ff10-2a41-46f0-a4d8-1769d585beb1-kube-api-access-75h6m" (OuterVolumeSpecName: "kube-api-access-75h6m") pod "e094ff10-2a41-46f0-a4d8-1769d585beb1" (UID: "e094ff10-2a41-46f0-a4d8-1769d585beb1"). InnerVolumeSpecName "kube-api-access-75h6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:56:09.857322 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.857196    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-dshm" (OuterVolumeSpecName: "dshm") pod "e094ff10-2a41-46f0-a4d8-1769d585beb1" (UID: "e094ff10-2a41-46f0-a4d8-1769d585beb1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:56:09.956517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.956479    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e094ff10-2a41-46f0-a4d8-1769d585beb1-tls-certs\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:09.956517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.956510    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75h6m\" (UniqueName: \"kubernetes.io/projected/e094ff10-2a41-46f0-a4d8-1769d585beb1-kube-api-access-75h6m\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:09.956517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:09.956524    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e094ff10-2a41-46f0-a4d8-1769d585beb1-dshm\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:10.428622 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:10.428588    2575 generic.go:356] "Generic (PLEG): container finished" podID="e094ff10-2a41-46f0-a4d8-1769d585beb1" containerID="c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b" exitCode=0
Jul 10 21:56:10.428788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:10.428637    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"
Jul 10 21:56:10.428788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:10.428681    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh" event={"ID":"e094ff10-2a41-46f0-a4d8-1769d585beb1","Type":"ContainerDied","Data":"c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b"}
Jul 10 21:56:10.428788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:10.428728    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh" event={"ID":"e094ff10-2a41-46f0-a4d8-1769d585beb1","Type":"ContainerDied","Data":"a9e6c83a3a712f0a7223c61f137715b19cdae4060f6546c388760d381b23fe0c"}
Jul 10 21:56:10.428788 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:10.428745    2575 scope.go:117] "RemoveContainer" containerID="c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b"
Jul 10 21:56:10.438574 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:10.438554    2575 scope.go:117] "RemoveContainer" containerID="c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b"
Jul 10 21:56:10.438844 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:56:10.438823    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b\": container with ID starting with c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b not found: ID does not exist" containerID="c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b"
Jul 10 21:56:10.438908 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:10.438857    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b"} err="failed to get container status \"c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b\": rpc error: code = NotFound desc = could not find container \"c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b\": container with ID starting with c53d855f91c74a0019dda84c279cb0f7bd6315fc719946c1847a8eb746d2e45b not found: ID does not exist"
Jul 10 21:56:10.449863 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:10.449831    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"]
Jul 10 21:56:10.453627 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:10.453602    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-7d633a/test-model-7d633a-kserve-5984fc769-v8hzh"]
Jul 10 21:56:11.523330 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:11.523296    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e094ff10-2a41-46f0-a4d8-1769d585beb1" path="/var/lib/kubelet/pods/e094ff10-2a41-46f0-a4d8-1769d585beb1/volumes"
Jul 10 21:56:12.997911 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:12.997876    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:56:15.629549 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:15.629522    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:56:15.639992 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:15.639968    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 21:56:15.819010 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:15.818975    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:15.919574 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:15.919481    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:20.543233 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:20.543147    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:20.791885 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:20.791849    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:21.511816 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:21.511774    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:21.615592 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:21.615554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:21.925146 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:21.925113    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:31.316592 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.316556    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"]
Jul 10 21:56:31.317159 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.316930    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz" podUID="e6cf5b0b-305c-4e58-afe6-b5779f62a62e" containerName="maas-api" containerID="cri-o://e2eef65b253d1c0c7ef1cdb50595a91950c9edeb976e54245e645bdc0a6be501" gracePeriod=30
Jul 10 21:56:31.387960 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.387922    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:31.547181 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.547148    2575 generic.go:356] "Generic (PLEG): container finished" podID="e6cf5b0b-305c-4e58-afe6-b5779f62a62e" containerID="e2eef65b253d1c0c7ef1cdb50595a91950c9edeb976e54245e645bdc0a6be501" exitCode=0
Jul 10 21:56:31.547352 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.547201    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz" event={"ID":"e6cf5b0b-305c-4e58-afe6-b5779f62a62e","Type":"ContainerDied","Data":"e2eef65b253d1c0c7ef1cdb50595a91950c9edeb976e54245e645bdc0a6be501"}
Jul 10 21:56:31.570241 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.570174    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:56:31.651841 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.651815    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-maas-api-tls\") pod \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\" (UID: \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\") "
Jul 10 21:56:31.652029 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.651906    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-openshift-service-ca\") pod \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\" (UID: \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\") "
Jul 10 21:56:31.652029 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.651985    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95gng\" (UniqueName: \"kubernetes.io/projected/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-kube-api-access-95gng\") pod \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\" (UID: \"e6cf5b0b-305c-4e58-afe6-b5779f62a62e\") "
Jul 10 21:56:31.652328 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.652299    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6cf5b0b-305c-4e58-afe6-b5779f62a62e" (UID: "e6cf5b0b-305c-4e58-afe6-b5779f62a62e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:56:31.654022 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.653998    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6cf5b0b-305c-4e58-afe6-b5779f62a62e" (UID: "e6cf5b0b-305c-4e58-afe6-b5779f62a62e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:56:31.654311 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.654286    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-kube-api-access-95gng" (OuterVolumeSpecName: "kube-api-access-95gng") pod "e6cf5b0b-305c-4e58-afe6-b5779f62a62e" (UID: "e6cf5b0b-305c-4e58-afe6-b5779f62a62e"). InnerVolumeSpecName "kube-api-access-95gng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:56:31.753282 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.753239    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-openshift-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:31.753458 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.753309    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95gng\" (UniqueName: \"kubernetes.io/projected/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-kube-api-access-95gng\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:31.753458 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:31.753320    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6cf5b0b-305c-4e58-afe6-b5779f62a62e-maas-api-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:32.554686 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:32.554649    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz" event={"ID":"e6cf5b0b-305c-4e58-afe6-b5779f62a62e","Type":"ContainerDied","Data":"805929f61e19766c893470a16ae85a20e57825d5c8d47a26fa927089f4e7cc3a"}
Jul 10 21:56:32.554686 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:32.554679    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"
Jul 10 21:56:32.555209 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:32.554717    2575 scope.go:117] "RemoveContainer" containerID="e2eef65b253d1c0c7ef1cdb50595a91950c9edeb976e54245e645bdc0a6be501"
Jul 10 21:56:32.575812 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:32.575786    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"]
Jul 10 21:56:32.580113 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:32.580087    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7d633a-78c859c66f-lgtpz"]
Jul 10 21:56:33.523505 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:33.523464    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6cf5b0b-305c-4e58-afe6-b5779f62a62e" path="/var/lib/kubelet/pods/e6cf5b0b-305c-4e58-afe6-b5779f62a62e/volumes"
Jul 10 21:56:34.699790 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:34.699754    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:56:36.003792 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:36.003754    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:41.716743 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:41.716708    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:41.819030 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:41.818992    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:46.717123 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:46.717084    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"]
Jul 10 21:56:46.717820 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:46.717768    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy" containerID="cri-o://702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e" gracePeriod=30
Jul 10 21:56:46.743877 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:46.743842    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:46.978459 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:46.978360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:47.343066 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:47.343027    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:47.679290 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:47.679178    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:47.992166 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:47.992064    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:50.376904 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.376864    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:50.447527 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.447491    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"]
Jul 10 21:56:50.447933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.447907    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e094ff10-2a41-46f0-a4d8-1769d585beb1" containerName="main"
Jul 10 21:56:50.447933 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.447924    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e094ff10-2a41-46f0-a4d8-1769d585beb1" containerName="main"
Jul 10 21:56:50.448087 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.447942    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6cf5b0b-305c-4e58-afe6-b5779f62a62e" containerName="maas-api"
Jul 10 21:56:50.448087 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.447949    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6cf5b0b-305c-4e58-afe6-b5779f62a62e" containerName="maas-api"
Jul 10 21:56:50.448087 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.447966    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93206766-2422-4325-97bd-762340372998" containerName="maas-api"
Jul 10 21:56:50.448087 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.447973    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="93206766-2422-4325-97bd-762340372998" containerName="maas-api"
Jul 10 21:56:50.448087 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.448038    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6cf5b0b-305c-4e58-afe6-b5779f62a62e" containerName="maas-api"
Jul 10 21:56:50.448087 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.448046    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e094ff10-2a41-46f0-a4d8-1769d585beb1" containerName="main"
Jul 10 21:56:50.448087 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.448054    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="93206766-2422-4325-97bd-762340372998" containerName="maas-api"
Jul 10 21:56:50.450064 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.450025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:50.451234 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.451214    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:50.453813 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.453788    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-205080-serving-cert\""
Jul 10 21:56:50.453940 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.453919    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-r7zht\""
Jul 10 21:56:50.464722 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.464695    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"]
Jul 10 21:56:50.513043 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.513000    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:50.516156 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.516126    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2nbt\" (UniqueName: \"kubernetes.io/projected/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-kube-api-access-s2nbt\") pod \"maas-api-e2e-api-a-205080-56c5b88cc6-cx94l\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:50.516307 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.516205    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-maas-api-tls\") pod \"maas-api-e2e-api-a-205080-56c5b88cc6-cx94l\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:50.516307 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.516236    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-openshift-service-ca\") pod \"maas-api-e2e-api-a-205080-56c5b88cc6-cx94l\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:50.617303 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.617234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2nbt\" (UniqueName: \"kubernetes.io/projected/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-kube-api-access-s2nbt\") pod \"maas-api-e2e-api-a-205080-56c5b88cc6-cx94l\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:50.617498 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.617355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-maas-api-tls\") pod \"maas-api-e2e-api-a-205080-56c5b88cc6-cx94l\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:50.617498 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.617381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-openshift-service-ca\") pod \"maas-api-e2e-api-a-205080-56c5b88cc6-cx94l\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:50.617623 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:56:50.617602    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-205080-serving-cert: secret "maas-api-e2e-api-a-205080-serving-cert" not found
Jul 10 21:56:50.617681 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:56:50.617675    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-maas-api-tls podName:ee5d7382-f6ce-4a5e-8752-33e1aa432e1f nodeName:}" failed. No retries permitted until 2026-07-10 21:56:51.117657585 +0000 UTC m=+2136.750902822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-maas-api-tls") pod "maas-api-e2e-api-a-205080-56c5b88cc6-cx94l" (UID: "ee5d7382-f6ce-4a5e-8752-33e1aa432e1f") : secret "maas-api-e2e-api-a-205080-serving-cert" not found
Jul 10 21:56:50.618076 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.618052    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-openshift-service-ca\") pod \"maas-api-e2e-api-a-205080-56c5b88cc6-cx94l\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:50.625687 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:50.625661    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2nbt\" (UniqueName: \"kubernetes.io/projected/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-kube-api-access-s2nbt\") pod \"maas-api-e2e-api-a-205080-56c5b88cc6-cx94l\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:51.024102 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:51.024061    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:51.122865 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:51.122822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-maas-api-tls\") pod \"maas-api-e2e-api-a-205080-56c5b88cc6-cx94l\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:51.123022 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:56:51.122968    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-205080-serving-cert: secret "maas-api-e2e-api-a-205080-serving-cert" not found
Jul 10 21:56:51.123090 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:56:51.123048    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-maas-api-tls podName:ee5d7382-f6ce-4a5e-8752-33e1aa432e1f nodeName:}" failed. No retries permitted until 2026-07-10 21:56:52.12303114 +0000 UTC m=+2137.756276372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-maas-api-tls") pod "maas-api-e2e-api-a-205080-56c5b88cc6-cx94l" (UID: "ee5d7382-f6ce-4a5e-8752-33e1aa432e1f") : secret "maas-api-e2e-api-a-205080-serving-cert" not found
Jul 10 21:56:51.124823 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:51.124786    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:51.225744 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:51.225701    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:51.982784 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:51.982724    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:56:52.029034 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029000    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istiod-ca-cert\") pod \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") "
Jul 10 21:56:52.029207 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029047    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-workload-socket\") pod \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") "
Jul 10 21:56:52.029207 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029073    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-workload-certs\") pod \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") "
Jul 10 21:56:52.029207 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029188    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-data\") pod \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") "
Jul 10 21:56:52.029405 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029221    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-podinfo\") pod \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") "
Jul 10 21:56:52.029405 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029335    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-credential-socket\") pod \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") "
Jul 10 21:56:52.029405 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029356    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "844b2afd-7faf-4017-870c-a4cbb2c1c2de" (UID: "844b2afd-7faf-4017-870c-a4cbb2c1c2de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:56:52.029405 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029372    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "844b2afd-7faf-4017-870c-a4cbb2c1c2de" (UID: "844b2afd-7faf-4017-870c-a4cbb2c1c2de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:56:52.029405 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029375    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-envoy\") pod \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") "
Jul 10 21:56:52.029682 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029459    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-token\") pod \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") "
Jul 10 21:56:52.029682 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029489    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zrbf\" (UniqueName: \"kubernetes.io/projected/844b2afd-7faf-4017-870c-a4cbb2c1c2de-kube-api-access-9zrbf\") pod \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\" (UID: \"844b2afd-7faf-4017-870c-a4cbb2c1c2de\") "
Jul 10 21:56:52.029682 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029488    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "844b2afd-7faf-4017-870c-a4cbb2c1c2de" (UID: "844b2afd-7faf-4017-870c-a4cbb2c1c2de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:56:52.029682 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029593    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "844b2afd-7faf-4017-870c-a4cbb2c1c2de" (UID: "844b2afd-7faf-4017-870c-a4cbb2c1c2de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:56:52.029835 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029779    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-workload-socket\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:52.029835 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029792    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-workload-certs\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:52.029835 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029801    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-credential-socket\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:52.029835 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.029814    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istiod-ca-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:52.030038 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.030017    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-data" (OuterVolumeSpecName: "istio-data") pod "844b2afd-7faf-4017-870c-a4cbb2c1c2de" (UID: "844b2afd-7faf-4017-870c-a4cbb2c1c2de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:56:52.032027 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.032003    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-token" (OuterVolumeSpecName: "istio-token") pod "844b2afd-7faf-4017-870c-a4cbb2c1c2de" (UID: "844b2afd-7faf-4017-870c-a4cbb2c1c2de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:56:52.032162 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.032033    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "844b2afd-7faf-4017-870c-a4cbb2c1c2de" (UID: "844b2afd-7faf-4017-870c-a4cbb2c1c2de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:56:52.032162 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.032049    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "844b2afd-7faf-4017-870c-a4cbb2c1c2de" (UID: "844b2afd-7faf-4017-870c-a4cbb2c1c2de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 21:56:52.032418 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.032396    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/844b2afd-7faf-4017-870c-a4cbb2c1c2de-kube-api-access-9zrbf" (OuterVolumeSpecName: "kube-api-access-9zrbf") pod "844b2afd-7faf-4017-870c-a4cbb2c1c2de" (UID: "844b2afd-7faf-4017-870c-a4cbb2c1c2de"). InnerVolumeSpecName "kube-api-access-9zrbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:56:52.130329 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.130265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-maas-api-tls\") pod \"maas-api-e2e-api-a-205080-56c5b88cc6-cx94l\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:52.130500 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.130380    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-data\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:52.130500 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.130390    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-podinfo\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:52.130500 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.130398    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-envoy\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:52.130500 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.130406    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844b2afd-7faf-4017-870c-a4cbb2c1c2de-istio-token\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:52.130500 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.130416    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zrbf\" (UniqueName: \"kubernetes.io/projected/844b2afd-7faf-4017-870c-a4cbb2c1c2de-kube-api-access-9zrbf\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:56:52.132712 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.132684    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-maas-api-tls\") pod \"maas-api-e2e-api-a-205080-56c5b88cc6-cx94l\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:52.264483 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.264395    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:52.405794 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.405767    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"]
Jul 10 21:56:52.407437 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:56:52.407402    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5d7382_f6ce_4a5e_8752_33e1aa432e1f.slice/crio-cf77c912f59560295edcfdb3c783827edb36cf5fdfda2bb7a6cb8d13d35f3ccd WatchSource:0}: Error finding container cf77c912f59560295edcfdb3c783827edb36cf5fdfda2bb7a6cb8d13d35f3ccd: Status 404 returned error can't find the container with id cf77c912f59560295edcfdb3c783827edb36cf5fdfda2bb7a6cb8d13d35f3ccd
Jul 10 21:56:52.408750 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.408733    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 21:56:52.669642 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.669603    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l" event={"ID":"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f","Type":"ContainerStarted","Data":"cf77c912f59560295edcfdb3c783827edb36cf5fdfda2bb7a6cb8d13d35f3ccd"}
Jul 10 21:56:52.671217 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.671193    2575 generic.go:356] "Generic (PLEG): container finished" podID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerID="702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e" exitCode=0
Jul 10 21:56:52.671374 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.671241    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"
Jul 10 21:56:52.671374 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.671304    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" event={"ID":"844b2afd-7faf-4017-870c-a4cbb2c1c2de","Type":"ContainerDied","Data":"702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e"}
Jul 10 21:56:52.671374 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.671357    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt" event={"ID":"844b2afd-7faf-4017-870c-a4cbb2c1c2de","Type":"ContainerDied","Data":"93cda0ac539e8e4758ff7a0e42c61d80476e0ccd9c22d1241117e9c0a02d4b11"}
Jul 10 21:56:52.671508 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.671382    2575 scope.go:117] "RemoveContainer" containerID="702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e"
Jul 10 21:56:52.681406 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.681390    2575 scope.go:117] "RemoveContainer" containerID="e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0"
Jul 10 21:56:52.689898 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.689878    2575 scope.go:117] "RemoveContainer" containerID="702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e"
Jul 10 21:56:52.690169 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:56:52.690149    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e\": container with ID starting with 702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e not found: ID does not exist" containerID="702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e"
Jul 10 21:56:52.690243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.690183    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e"} err="failed to get container status \"702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e\": rpc error: code = NotFound desc = could not find container \"702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e\": container with ID starting with 702ecf8275700a5c6693752d0c7c9d04f70726c0953e75930c5547b8f714071e not found: ID does not exist"
Jul 10 21:56:52.690243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.690208    2575 scope.go:117] "RemoveContainer" containerID="e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0"
Jul 10 21:56:52.690498 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:56:52.690479    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0\": container with ID starting with e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0 not found: ID does not exist" containerID="e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0"
Jul 10 21:56:52.690538 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.690506    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0"} err="failed to get container status \"e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0\": rpc error: code = NotFound desc = could not find container \"e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0\": container with ID starting with e20f86a767586cddd54e279f79144a3c824d5b204f9b7928594838a5c6cb25a0 not found: ID does not exist"
Jul 10 21:56:52.694869 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.694847    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"]
Jul 10 21:56:52.702888 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:52.702860    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-7d633a-openshift-default-cfdb5d467-kt7wt"]
Jul 10 21:56:53.524324 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:53.524292    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" path="/var/lib/kubelet/pods/844b2afd-7faf-4017-870c-a4cbb2c1c2de/volumes"
Jul 10 21:56:53.677463 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:53.677423    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l" event={"ID":"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f","Type":"ContainerStarted","Data":"f0cc2e82cf302e7b73b703ac8bf34cb684e97f04abd9c035c1ddbd0f3326f953"}
Jul 10 21:56:53.677649 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:53.677489    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:53.694864 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:53.694812    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l" podStartSLOduration=3.294054384 podStartE2EDuration="3.694795246s" totalImagesPullingTime="400.740862ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:56:53.69362965 +0000 UTC m=+2139.326874904" watchObservedRunningTime="2026-07-10 21:56:53.694795246 +0000 UTC m=+2139.328040503"
Jul 10 21:56:54.921646 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:54.921616    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:55.365935 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.365899    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:55.637234 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.637140    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"]
Jul 10 21:56:55.637768 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.637742    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy"
Jul 10 21:56:55.637929 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.637907    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy"
Jul 10 21:56:55.638044 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.637940    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy"
Jul 10 21:56:55.638044 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.637951    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy"
Jul 10 21:56:55.638155 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.638061    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy"
Jul 10 21:56:55.641459 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.641438    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.643670 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.643649    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-85696a-openshift-default-dockercfg-p7tv9\""
Jul 10 21:56:55.652760 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.652728    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"]
Jul 10 21:56:55.657630 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.657599    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:55.661627 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.661608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-data\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.661719 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.661634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-token\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.661719 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.661653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-workload-certs\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.661719 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.661698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-credential-socket\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.661846 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.661740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-envoy\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.661846 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.661772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75p79\" (UniqueName: \"kubernetes.io/projected/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-kube-api-access-75p79\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.661846 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.661827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istiod-ca-cert\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.661956 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.661881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-workload-socket\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.661956 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.661919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-podinfo\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.763330 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.763287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istiod-ca-cert\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.763540 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.763359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-workload-socket\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.763540 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.763395    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-podinfo\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.763540 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.763452    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-data\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.763540 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.763479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-token\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.763540 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.763505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-workload-certs\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.763540 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.763532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-credential-socket\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.763922 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.763560    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-envoy\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.763922 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.763590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75p79\" (UniqueName: \"kubernetes.io/projected/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-kube-api-access-75p79\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.763922 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.763901    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-data\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.764087 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.763925    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-workload-certs\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.764087 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.764062    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-credential-socket\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.764176 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.764104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istiod-ca-cert\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.764242 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.764190    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-workload-socket\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.766127 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.766103    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-envoy\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.766232 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.766216    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-podinfo\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.773316 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.773262    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-token\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.773583 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.773564    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75p79\" (UniqueName: \"kubernetes.io/projected/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-kube-api-access-75p79\") pod \"e2e-api-b-85696a-openshift-default-7b8956f95-fchcl\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") " pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:55.867775 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.867738    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:55.952777 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:55.952688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:56.107539 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:56.107507    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"]
Jul 10 21:56:56.109001 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:56:56.108971    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ed9857_ccbf_4944_90b4_0d8a17e6adfe.slice/crio-0ddcb4330784110adcec2065f7faeaf38fc32978b4f508cf54e6736e00e107ab WatchSource:0}: Error finding container 0ddcb4330784110adcec2065f7faeaf38fc32978b4f508cf54e6736e00e107ab: Status 404 returned error can't find the container with id 0ddcb4330784110adcec2065f7faeaf38fc32978b4f508cf54e6736e00e107ab
Jul 10 21:56:56.111168 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:56.111134    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:56:56.111246 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:56.111205    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:56:56.111246 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:56.111233    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:56:56.193064 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:56.193022    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:56:56.696662 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:56.696631    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl" event={"ID":"52ed9857-ccbf-4944-90b4-0d8a17e6adfe","Type":"ContainerStarted","Data":"7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a"}
Jul 10 21:56:56.696849 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:56.696685    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl" event={"ID":"52ed9857-ccbf-4944-90b4-0d8a17e6adfe","Type":"ContainerStarted","Data":"0ddcb4330784110adcec2065f7faeaf38fc32978b4f508cf54e6736e00e107ab"}
Jul 10 21:56:56.717977 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:56.717925    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl" podStartSLOduration=1.717909474 podStartE2EDuration="1.717909474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:56:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:56:56.715920073 +0000 UTC m=+2142.349165330" watchObservedRunningTime="2026-07-10 21:56:56.717909474 +0000 UTC m=+2142.351154727"
Jul 10 21:56:56.953304 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:56.953206    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:57.958351 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:57.958321    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:58.679156 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.679125    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:58.706950 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.706920    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:58.707736 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.707718    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:56:58.756944 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.756900    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"]
Jul 10 21:56:58.757664 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.757638    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="844b2afd-7faf-4017-870c-a4cbb2c1c2de" containerName="istio-proxy"
Jul 10 21:56:58.761397 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.761373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:56:58.766543 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.766520    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-85696a-serving-cert\""
Jul 10 21:56:58.776313 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.776288    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"]
Jul 10 21:56:58.779227 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.779201    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:58.790736 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.790700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q892g\" (UniqueName: \"kubernetes.io/projected/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-kube-api-access-q892g\") pod \"maas-api-e2e-api-b-85696a-67db9bb979-ksw58\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:56:58.791049 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.791025    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-maas-api-tls\") pod \"maas-api-e2e-api-b-85696a-67db9bb979-ksw58\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:56:58.791156 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.791098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-openshift-service-ca\") pod \"maas-api-e2e-api-b-85696a-67db9bb979-ksw58\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:56:58.853679 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.853641    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:58.891996 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.891959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-openshift-service-ca\") pod \"maas-api-e2e-api-b-85696a-67db9bb979-ksw58\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:56:58.892199 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.892096    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q892g\" (UniqueName: \"kubernetes.io/projected/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-kube-api-access-q892g\") pod \"maas-api-e2e-api-b-85696a-67db9bb979-ksw58\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:56:58.892199 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.892153    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-maas-api-tls\") pod \"maas-api-e2e-api-b-85696a-67db9bb979-ksw58\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:56:58.892338 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:56:58.892320    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-serving-cert: secret "maas-api-e2e-api-b-85696a-serving-cert" not found
Jul 10 21:56:58.892394 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:56:58.892383    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-maas-api-tls podName:be76fb7e-a69e-4be6-95cd-b1d6093ed7b9 nodeName:}" failed. No retries permitted until 2026-07-10 21:56:59.392363531 +0000 UTC m=+2145.025608778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-maas-api-tls") pod "maas-api-e2e-api-b-85696a-67db9bb979-ksw58" (UID: "be76fb7e-a69e-4be6-95cd-b1d6093ed7b9") : secret "maas-api-e2e-api-b-85696a-serving-cert" not found
Jul 10 21:56:58.892901 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.892880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-openshift-service-ca\") pod \"maas-api-e2e-api-b-85696a-67db9bb979-ksw58\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:56:58.901012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:58.900991    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q892g\" (UniqueName: \"kubernetes.io/projected/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-kube-api-access-q892g\") pod \"maas-api-e2e-api-b-85696a-67db9bb979-ksw58\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:56:59.187803 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:59.187772    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:59.348038 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:59.348004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:59.397265 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:59.397223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-maas-api-tls\") pod \"maas-api-e2e-api-b-85696a-67db9bb979-ksw58\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:56:59.399652 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:59.399624    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-maas-api-tls\") pod \"maas-api-e2e-api-b-85696a-67db9bb979-ksw58\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:56:59.453606 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:59.453514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:56:59.675766 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:59.675733    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:56:59.690473 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:59.690448    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:56:59.819829 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:56:59.819793    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"]
Jul 10 21:56:59.821373 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:56:59.821338    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe76fb7e_a69e_4be6_95cd_b1d6093ed7b9.slice/crio-7251fa1fd8c38825743665a9038b947cb5507e5e5cab6a1b375e008c47e08383 WatchSource:0}: Error finding container 7251fa1fd8c38825743665a9038b947cb5507e5e5cab6a1b375e008c47e08383: Status 404 returned error can't find the container with id 7251fa1fd8c38825743665a9038b947cb5507e5e5cab6a1b375e008c47e08383
Jul 10 21:57:00.719584 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:00.719550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58" event={"ID":"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9","Type":"ContainerStarted","Data":"04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3"}
Jul 10 21:57:00.719978 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:00.719598    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58" event={"ID":"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9","Type":"ContainerStarted","Data":"7251fa1fd8c38825743665a9038b947cb5507e5e5cab6a1b375e008c47e08383"}
Jul 10 21:57:00.719978 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:00.719645    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:57:00.736712 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:00.736663    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58" podStartSLOduration=2.327040729 podStartE2EDuration="2.736648036s" totalImagesPullingTime="409.607307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:57:00.736080213 +0000 UTC m=+2146.369325466" watchObservedRunningTime="2026-07-10 21:57:00.736648036 +0000 UTC m=+2146.369893288"
Jul 10 21:57:03.243051 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:03.243010    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:06.730460 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:06.730379    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:57:09.700482 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:09.700446    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:57:10.798768 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:10.798739    2575 generic.go:356] "Generic (PLEG): container finished" podID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerID="7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a" exitCode=0
Jul 10 21:57:10.799186 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:10.798811    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl" event={"ID":"52ed9857-ccbf-4944-90b4-0d8a17e6adfe","Type":"ContainerDied","Data":"7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a"}
Jul 10 21:57:10.799231 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:10.799189    2575 scope.go:117] "RemoveContainer" containerID="7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a"
Jul 10 21:57:10.800211 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:10.800177    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:57:10.800298 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:10.800267    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:57:10.800346 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:10.800332    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:57:11.805619 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:11.805586    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl" event={"ID":"52ed9857-ccbf-4944-90b4-0d8a17e6adfe","Type":"ContainerStarted","Data":"6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215"}
Jul 10 21:57:11.953534 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:11.953490    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:57:11.955319 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:11.955204    2575 patch_prober.go:28] interesting pod/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 10 21:57:11.955548 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:11.955522    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl" podUID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 10 21:57:12.028806 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:12.028767    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:12.129836 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:12.129802    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:12.953929 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:12.953879    2575 patch_prober.go:28] interesting pod/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 10 21:57:12.954455 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:12.953954    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl" podUID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 10 21:57:13.707198 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:13.707161    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:57:13.953846 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:13.953804    2575 patch_prober.go:28] interesting pod/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 10 21:57:13.954054 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:13.953876    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl" podUID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 10 21:57:14.954183 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:14.954137    2575 patch_prober.go:28] interesting pod/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 10 21:57:14.954710 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:14.954210    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl" podUID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 10 21:57:15.957124 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:15.957039    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:57:15.958149 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:15.958129    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:57:20.061401 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:20.061367    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:20.162350 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:20.162319    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:23.490345 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:23.490287    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:23.603756 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:23.603704    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:23.714594 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:23.714559    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"]
Jul 10 21:57:23.714832 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:23.714808    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l" podUID="ee5d7382-f6ce-4a5e-8752-33e1aa432e1f" containerName="maas-api" containerID="cri-o://f0cc2e82cf302e7b73b703ac8bf34cb684e97f04abd9c035c1ddbd0f3326f953" gracePeriod=30
Jul 10 21:57:23.742160 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:23.742089    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:23.878924 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:23.878891    2575 generic.go:356] "Generic (PLEG): container finished" podID="ee5d7382-f6ce-4a5e-8752-33e1aa432e1f" containerID="f0cc2e82cf302e7b73b703ac8bf34cb684e97f04abd9c035c1ddbd0f3326f953" exitCode=0
Jul 10 21:57:23.879104 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:23.878975    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l" event={"ID":"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f","Type":"ContainerDied","Data":"f0cc2e82cf302e7b73b703ac8bf34cb684e97f04abd9c035c1ddbd0f3326f953"}
Jul 10 21:57:23.976581 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:23.976550    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:57:24.139047 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.139004    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-maas-api-tls\") pod \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") "
Jul 10 21:57:24.139225 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.139079    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2nbt\" (UniqueName: \"kubernetes.io/projected/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-kube-api-access-s2nbt\") pod \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") "
Jul 10 21:57:24.139225 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.139099    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-openshift-service-ca\") pod \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\" (UID: \"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f\") "
Jul 10 21:57:24.139585 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.139561    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ee5d7382-f6ce-4a5e-8752-33e1aa432e1f" (UID: "ee5d7382-f6ce-4a5e-8752-33e1aa432e1f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:57:24.141314 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.141264    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ee5d7382-f6ce-4a5e-8752-33e1aa432e1f" (UID: "ee5d7382-f6ce-4a5e-8752-33e1aa432e1f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:57:24.141432 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.141309    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-kube-api-access-s2nbt" (OuterVolumeSpecName: "kube-api-access-s2nbt") pod "ee5d7382-f6ce-4a5e-8752-33e1aa432e1f" (UID: "ee5d7382-f6ce-4a5e-8752-33e1aa432e1f"). InnerVolumeSpecName "kube-api-access-s2nbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:57:24.240069 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.240033    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-maas-api-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:57:24.240069 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.240063    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2nbt\" (UniqueName: \"kubernetes.io/projected/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-kube-api-access-s2nbt\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:57:24.240069 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.240074    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f-openshift-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:57:24.885908 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.885866    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l" event={"ID":"ee5d7382-f6ce-4a5e-8752-33e1aa432e1f","Type":"ContainerDied","Data":"cf77c912f59560295edcfdb3c783827edb36cf5fdfda2bb7a6cb8d13d35f3ccd"}
Jul 10 21:57:24.885908 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.885888    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"
Jul 10 21:57:24.886488 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.885932    2575 scope.go:117] "RemoveContainer" containerID="f0cc2e82cf302e7b73b703ac8bf34cb684e97f04abd9c035c1ddbd0f3326f953"
Jul 10 21:57:24.908230 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.908201    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"]
Jul 10 21:57:24.910426 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:24.910400    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-205080-56c5b88cc6-cx94l"]
Jul 10 21:57:25.524527 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:25.524495    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee5d7382-f6ce-4a5e-8752-33e1aa432e1f" path="/var/lib/kubelet/pods/ee5d7382-f6ce-4a5e-8752-33e1aa432e1f/volumes"
Jul 10 21:57:27.096487 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:27.096446    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:57:28.070794 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:28.070759    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:34.091590 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:34.091553    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:34.170503 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:34.170471    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:38.725904 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:38.725867    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:38.967878 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:38.967843    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:39.589695 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:39.589655    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:39.690014 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:39.689976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:49.491076 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.491027    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"]
Jul 10 21:57:49.491586 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.491299    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58" podUID="be76fb7e-a69e-4be6-95cd-b1d6093ed7b9" containerName="maas-api" containerID="cri-o://04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3" gracePeriod=30
Jul 10 21:57:49.516222 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.516194    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:49.766689 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.766664    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:57:49.875165 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.875127    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q892g\" (UniqueName: \"kubernetes.io/projected/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-kube-api-access-q892g\") pod \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") "
Jul 10 21:57:49.875397 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.875177    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-maas-api-tls\") pod \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") "
Jul 10 21:57:49.875397 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.875247    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-openshift-service-ca\") pod \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\" (UID: \"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9\") "
Jul 10 21:57:49.875696 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.875670    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "be76fb7e-a69e-4be6-95cd-b1d6093ed7b9" (UID: "be76fb7e-a69e-4be6-95cd-b1d6093ed7b9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:57:49.877301 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.877254    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "be76fb7e-a69e-4be6-95cd-b1d6093ed7b9" (UID: "be76fb7e-a69e-4be6-95cd-b1d6093ed7b9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:57:49.877403 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.877328    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-kube-api-access-q892g" (OuterVolumeSpecName: "kube-api-access-q892g") pod "be76fb7e-a69e-4be6-95cd-b1d6093ed7b9" (UID: "be76fb7e-a69e-4be6-95cd-b1d6093ed7b9"). InnerVolumeSpecName "kube-api-access-q892g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:57:49.975981 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.975946    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-openshift-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:57:49.975981 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.975979    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q892g\" (UniqueName: \"kubernetes.io/projected/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-kube-api-access-q892g\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:57:49.975981 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:49.975989    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9-maas-api-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:57:50.026902 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:50.026806    2575 generic.go:356] "Generic (PLEG): container finished" podID="be76fb7e-a69e-4be6-95cd-b1d6093ed7b9" containerID="04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3" exitCode=0
Jul 10 21:57:50.026902 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:50.026853    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"
Jul 10 21:57:50.027141 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:50.026896    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58" event={"ID":"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9","Type":"ContainerDied","Data":"04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3"}
Jul 10 21:57:50.027141 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:50.026983    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58" event={"ID":"be76fb7e-a69e-4be6-95cd-b1d6093ed7b9","Type":"ContainerDied","Data":"7251fa1fd8c38825743665a9038b947cb5507e5e5cab6a1b375e008c47e08383"}
Jul 10 21:57:50.027141 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:50.027015    2575 scope.go:117] "RemoveContainer" containerID="04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3"
Jul 10 21:57:50.037504 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:50.037479    2575 scope.go:117] "RemoveContainer" containerID="04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3"
Jul 10 21:57:50.037773 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:57:50.037755    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3\": container with ID starting with 04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3 not found: ID does not exist" containerID="04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3"
Jul 10 21:57:50.037838 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:50.037782    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3"} err="failed to get container status \"04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3\": rpc error: code = NotFound desc = could not find container \"04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3\": container with ID starting with 04c3c8836d075f34a01ff0ac0ebfddfe218382897ff2464bbf924c050049b1c3 not found: ID does not exist"
Jul 10 21:57:50.048067 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:50.048039    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"]
Jul 10 21:57:50.052518 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:50.052497    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-85696a-67db9bb979-ksw58"]
Jul 10 21:57:51.524013 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:51.523970    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be76fb7e-a69e-4be6-95cd-b1d6093ed7b9" path="/var/lib/kubelet/pods/be76fb7e-a69e-4be6-95cd-b1d6093ed7b9/volumes"
Jul 10 21:57:52.688458 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:52.688426    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:57:54.187595 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:54.187545    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:59.878191 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:59.878156    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:57:59.976305 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:57:59.976248    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:04.871757 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:04.871719    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"]
Jul 10 21:58:04.872370 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:04.871993    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl" podUID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerName="istio-proxy" containerID="cri-o://6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215" gracePeriod=30
Jul 10 21:58:04.885790 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:04.885755    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:05.127002 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:05.126907    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:05.516038 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:05.515944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:05.784627 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:05.784529    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:06.089762 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:06.089728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:08.704916 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.704877    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:08.790104 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.790068    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"]
Jul 10 21:58:08.790605 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.790584    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5d7382-f6ce-4a5e-8752-33e1aa432e1f" containerName="maas-api"
Jul 10 21:58:08.790716 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.790607    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5d7382-f6ce-4a5e-8752-33e1aa432e1f" containerName="maas-api"
Jul 10 21:58:08.790716 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.790649    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be76fb7e-a69e-4be6-95cd-b1d6093ed7b9" containerName="maas-api"
Jul 10 21:58:08.790716 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.790657    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="be76fb7e-a69e-4be6-95cd-b1d6093ed7b9" containerName="maas-api"
Jul 10 21:58:08.790880 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.790752    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee5d7382-f6ce-4a5e-8752-33e1aa432e1f" containerName="maas-api"
Jul 10 21:58:08.790880 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.790767    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="be76fb7e-a69e-4be6-95cd-b1d6093ed7b9" containerName="maas-api"
Jul 10 21:58:08.791774 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.791743    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:08.795531 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.795513    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:08.797988 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.797967    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-22d37c-serving-cert\""
Jul 10 21:58:08.798108 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.798059    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-r7zht\""
Jul 10 21:58:08.805637 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.805594    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"]
Jul 10 21:58:08.879348 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.879317    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:08.940111 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.940071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4443437-06eb-4543-8075-92c664769dfd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:08.940349 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.940124    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4443437-06eb-4543-8075-92c664769dfd-maas-api-tls\") pod \"maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:08.940349 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:08.940154    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7pb6\" (UniqueName: \"kubernetes.io/projected/d4443437-06eb-4543-8075-92c664769dfd-kube-api-access-k7pb6\") pod \"maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:09.041359 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:09.041238    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4443437-06eb-4543-8075-92c664769dfd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:09.041359 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:09.041349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4443437-06eb-4543-8075-92c664769dfd-maas-api-tls\") pod \"maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:09.041601 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:09.041388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7pb6\" (UniqueName: \"kubernetes.io/projected/d4443437-06eb-4543-8075-92c664769dfd-kube-api-access-k7pb6\") pod \"maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:09.041601 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:58:09.041526    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-serving-cert: secret "maas-api-e2e-shared-a-22d37c-serving-cert" not found
Jul 10 21:58:09.041601 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:58:09.041585    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4443437-06eb-4543-8075-92c664769dfd-maas-api-tls podName:d4443437-06eb-4543-8075-92c664769dfd nodeName:}" failed. No retries permitted until 2026-07-10 21:58:09.54156583 +0000 UTC m=+2215.174811065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d4443437-06eb-4543-8075-92c664769dfd-maas-api-tls") pod "maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff" (UID: "d4443437-06eb-4543-8075-92c664769dfd") : secret "maas-api-e2e-shared-a-22d37c-serving-cert" not found
Jul 10 21:58:09.042012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:09.041989    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4443437-06eb-4543-8075-92c664769dfd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:09.049810 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:09.049787    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7pb6\" (UniqueName: \"kubernetes.io/projected/d4443437-06eb-4543-8075-92c664769dfd-kube-api-access-k7pb6\") pod \"maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:09.178318 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:09.178285    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:09.356911 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:09.356878    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:09.457548 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:09.457510    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:09.545673 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:09.545643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4443437-06eb-4543-8075-92c664769dfd-maas-api-tls\") pod \"maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:09.548039 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:09.548012    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4443437-06eb-4543-8075-92c664769dfd-maas-api-tls\") pod \"maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:09.709100 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:09.709013    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:09.848483 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:09.848443    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"]
Jul 10 21:58:09.849855 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:58:09.849829    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4443437_06eb_4543_8075_92c664769dfd.slice/crio-d25478e60b351b86dbddf21a4079ea4def1e002d5452755a2213a1e0118c4669 WatchSource:0}: Error finding container d25478e60b351b86dbddf21a4079ea4def1e002d5452755a2213a1e0118c4669: Status 404 returned error can't find the container with id d25478e60b351b86dbddf21a4079ea4def1e002d5452755a2213a1e0118c4669
Jul 10 21:58:10.126143 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.126118    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:58:10.138846 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.138812    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff" event={"ID":"d4443437-06eb-4543-8075-92c664769dfd","Type":"ContainerStarted","Data":"d25478e60b351b86dbddf21a4079ea4def1e002d5452755a2213a1e0118c4669"}
Jul 10 21:58:10.140536 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.140504    2575 generic.go:356] "Generic (PLEG): container finished" podID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerID="6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215" exitCode=0
Jul 10 21:58:10.140669 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.140563    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"
Jul 10 21:58:10.140669 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.140571    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl" event={"ID":"52ed9857-ccbf-4944-90b4-0d8a17e6adfe","Type":"ContainerDied","Data":"6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215"}
Jul 10 21:58:10.140669 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.140623    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl" event={"ID":"52ed9857-ccbf-4944-90b4-0d8a17e6adfe","Type":"ContainerDied","Data":"0ddcb4330784110adcec2065f7faeaf38fc32978b4f508cf54e6736e00e107ab"}
Jul 10 21:58:10.140841 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.140666    2575 scope.go:117] "RemoveContainer" containerID="6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215"
Jul 10 21:58:10.149726 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.149706    2575 scope.go:117] "RemoveContainer" containerID="7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a"
Jul 10 21:58:10.159820 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.159800    2575 scope.go:117] "RemoveContainer" containerID="6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215"
Jul 10 21:58:10.160169 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:58:10.160150    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215\": container with ID starting with 6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215 not found: ID does not exist" containerID="6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215"
Jul 10 21:58:10.160243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.160184    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215"} err="failed to get container status \"6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215\": rpc error: code = NotFound desc = could not find container \"6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215\": container with ID starting with 6450f50c316e537e933929b457d0d1f6c21e81c05910e5d5a0a2870b97a91215 not found: ID does not exist"
Jul 10 21:58:10.160243 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.160211    2575 scope.go:117] "RemoveContainer" containerID="7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a"
Jul 10 21:58:10.160532 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:58:10.160510    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a\": container with ID starting with 7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a not found: ID does not exist" containerID="7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a"
Jul 10 21:58:10.160577 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.160540    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a"} err="failed to get container status \"7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a\": rpc error: code = NotFound desc = could not find container \"7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a\": container with ID starting with 7a73464e3530159c2bfa3c040e8a26e2b6e358cf023d3205d454f561808bfa8a not found: ID does not exist"
Jul 10 21:58:10.252347 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.251607    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-podinfo\") pod \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") "
Jul 10 21:58:10.252347 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.251666    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-workload-socket\") pod \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") "
Jul 10 21:58:10.252347 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.251712    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istiod-ca-cert\") pod \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") "
Jul 10 21:58:10.252347 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.251744    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-envoy\") pod \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") "
Jul 10 21:58:10.252347 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.251774    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-token\") pod \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") "
Jul 10 21:58:10.252347 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.251797    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-workload-certs\") pod \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") "
Jul 10 21:58:10.252347 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.251829    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-data\") pod \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") "
Jul 10 21:58:10.252347 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.251855    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-credential-socket\") pod \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") "
Jul 10 21:58:10.252347 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.251880    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75p79\" (UniqueName: \"kubernetes.io/projected/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-kube-api-access-75p79\") pod \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\" (UID: \"52ed9857-ccbf-4944-90b4-0d8a17e6adfe\") "
Jul 10 21:58:10.253803 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.253134    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "52ed9857-ccbf-4944-90b4-0d8a17e6adfe" (UID: "52ed9857-ccbf-4944-90b4-0d8a17e6adfe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:58:10.253803 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.253311    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "52ed9857-ccbf-4944-90b4-0d8a17e6adfe" (UID: "52ed9857-ccbf-4944-90b4-0d8a17e6adfe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:58:10.253803 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.253485    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "52ed9857-ccbf-4944-90b4-0d8a17e6adfe" (UID: "52ed9857-ccbf-4944-90b4-0d8a17e6adfe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:58:10.253803 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.253537    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "52ed9857-ccbf-4944-90b4-0d8a17e6adfe" (UID: "52ed9857-ccbf-4944-90b4-0d8a17e6adfe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 21:58:10.253803 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.253760    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-data" (OuterVolumeSpecName: "istio-data") pod "52ed9857-ccbf-4944-90b4-0d8a17e6adfe" (UID: "52ed9857-ccbf-4944-90b4-0d8a17e6adfe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:58:10.259332 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.259300    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "52ed9857-ccbf-4944-90b4-0d8a17e6adfe" (UID: "52ed9857-ccbf-4944-90b4-0d8a17e6adfe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:58:10.259448 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.259419    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-token" (OuterVolumeSpecName: "istio-token") pod "52ed9857-ccbf-4944-90b4-0d8a17e6adfe" (UID: "52ed9857-ccbf-4944-90b4-0d8a17e6adfe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:58:10.259517 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.259498    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "52ed9857-ccbf-4944-90b4-0d8a17e6adfe" (UID: "52ed9857-ccbf-4944-90b4-0d8a17e6adfe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 21:58:10.259695 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.259681    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-kube-api-access-75p79" (OuterVolumeSpecName: "kube-api-access-75p79") pod "52ed9857-ccbf-4944-90b4-0d8a17e6adfe" (UID: "52ed9857-ccbf-4944-90b4-0d8a17e6adfe"). InnerVolumeSpecName "kube-api-access-75p79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:58:10.353614 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.353584    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-podinfo\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:58:10.353734 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.353619    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-workload-socket\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:58:10.353734 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.353635    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istiod-ca-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:58:10.353734 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.353648    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-envoy\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:58:10.353734 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.353661    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-token\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:58:10.353734 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.353673    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-workload-certs\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:58:10.353734 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.353684    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-istio-data\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:58:10.353734 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.353696    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-credential-socket\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:58:10.353734 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.353712    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75p79\" (UniqueName: \"kubernetes.io/projected/52ed9857-ccbf-4944-90b4-0d8a17e6adfe-kube-api-access-75p79\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 21:58:10.466569 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.466536    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"]
Jul 10 21:58:10.469973 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:10.469949    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-85696a-openshift-default-7b8956f95-fchcl"]
Jul 10 21:58:11.148237 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:11.148199    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff" event={"ID":"d4443437-06eb-4543-8075-92c664769dfd","Type":"ContainerStarted","Data":"e9107d98805000c3e1365a8a02739ca21f14e06b271ef8b96ee283ec31e893b1"}
Jul 10 21:58:11.148674 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:11.148261    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:11.166787 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:11.166737    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff" podStartSLOduration=2.71648193 podStartE2EDuration="3.166721633s" totalImagesPullingTime="450.239703ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:58:11.164211089 +0000 UTC m=+2216.797456346" watchObservedRunningTime="2026-07-10 21:58:11.166721633 +0000 UTC m=+2216.799966887"
Jul 10 21:58:11.523768 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:11.523675    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" path="/var/lib/kubelet/pods/52ed9857-ccbf-4944-90b4-0d8a17e6adfe/volumes"
Jul 10 21:58:13.224515 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.224468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:13.668787 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.668744    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:13.856291 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.856238    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"]
Jul 10 21:58:13.856785 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.856709    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerName="istio-proxy"
Jul 10 21:58:13.856785 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.856731    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerName="istio-proxy"
Jul 10 21:58:13.856785 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.856742    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerName="istio-proxy"
Jul 10 21:58:13.856785 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.856750    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerName="istio-proxy"
Jul 10 21:58:13.857037 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.856980    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerName="istio-proxy"
Jul 10 21:58:13.860460 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.860438    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:13.863064 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.863038    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f937a7-openshift-default-dockercfg-cj2pm\""
Jul 10 21:58:13.874024 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.873997    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"]
Jul 10 21:58:13.887126 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.887101    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:13.986186 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.986094    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-workload-socket\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:13.986186 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.986146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-data\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:13.986445 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.986229    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-workload-certs\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:13.986445 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.986261    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-credential-socket\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:13.986445 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.986301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-token\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:13.986445 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.986400    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-podinfo\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:13.986445 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.986440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm6vv\" (UniqueName: \"kubernetes.io/projected/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-kube-api-access-mm6vv\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:13.986658 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.986473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istiod-ca-cert\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:13.986658 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:13.986506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-envoy\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.087463 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.087422    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-podinfo\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.087463 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.087465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm6vv\" (UniqueName: \"kubernetes.io/projected/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-kube-api-access-mm6vv\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.087722 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.087496    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istiod-ca-cert\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.087722 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.087526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-envoy\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.087722 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.087577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-workload-socket\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.087905 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.087718    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-data\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.087905 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.087796    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-workload-certs\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.087905 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.087827    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-credential-socket\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.087905 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.087853    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-token\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.088116 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.087999    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-workload-socket\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.088116 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.088105    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-data\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.088222 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.088151    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-workload-certs\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.088436 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.088414    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istiod-ca-cert\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.088508 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.088417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-credential-socket\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.090443 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.090416    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-podinfo\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.090561 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.090442    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-envoy\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.096206 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.096181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-token\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.096440 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.096421    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm6vv\" (UniqueName: \"kubernetes.io/projected/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-kube-api-access-mm6vv\") pod \"e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") " pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.174031 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.174003    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:14.198636 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.198606    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:58:14.323982 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.323947    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"]
Jul 10 21:58:14.324727 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:58:14.324698    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72d7d00_4660_4bfb_8bd8_90b273cc70d0.slice/crio-7687e720091c7eb58ee0ea5a25ae3a38031775d28319676b307c31b5336e1794 WatchSource:0}: Error finding container 7687e720091c7eb58ee0ea5a25ae3a38031775d28319676b307c31b5336e1794: Status 404 returned error can't find the container with id 7687e720091c7eb58ee0ea5a25ae3a38031775d28319676b307c31b5336e1794
Jul 10 21:58:14.326945 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.326909    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:58:14.327038 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.326971    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:58:14.327038 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.327002    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:58:14.384487 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:14.384458    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:15.172669 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:15.172630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h" event={"ID":"b72d7d00-4660-4bfb-8bd8-90b273cc70d0","Type":"ContainerStarted","Data":"a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f"}
Jul 10 21:58:15.172872 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:15.172688    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h" event={"ID":"b72d7d00-4660-4bfb-8bd8-90b273cc70d0","Type":"ContainerStarted","Data":"7687e720091c7eb58ee0ea5a25ae3a38031775d28319676b307c31b5336e1794"}
Jul 10 21:58:15.175012 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:15.174995    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:15.180114 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:15.180095    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:15.194682 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:15.194641    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h" podStartSLOduration=2.194628009 podStartE2EDuration="2.194628009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:58:15.192715919 +0000 UTC m=+2220.825961174" watchObservedRunningTime="2026-07-10 21:58:15.194628009 +0000 UTC m=+2220.827873263"
Jul 10 21:58:16.178572 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:16.178537    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:16.179649 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:16.179630    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:16.705035 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:16.704993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:16.803038 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:16.803007    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:17.115335 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.115293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:17.161195 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.161167    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 21:58:17.195023 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.194991    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"]
Jul 10 21:58:17.195472 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.195464    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="52ed9857-ccbf-4944-90b4-0d8a17e6adfe" containerName="istio-proxy"
Jul 10 21:58:17.199995 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.199968    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:17.204089 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.204055    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-f937a7-serving-cert\""
Jul 10 21:58:17.215120 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.215086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b0fb19e-4509-4f95-8ed6-1954331df960-maas-api-tls\") pod \"maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:17.215255 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.215136    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swzkb\" (UniqueName: \"kubernetes.io/projected/5b0fb19e-4509-4f95-8ed6-1954331df960-kube-api-access-swzkb\") pod \"maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:17.215665 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.215635    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"]
Jul 10 21:58:17.215804 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.215654    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b0fb19e-4509-4f95-8ed6-1954331df960-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:17.220111 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.220084    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:17.315132 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.315077    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:17.316380 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.316354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b0fb19e-4509-4f95-8ed6-1954331df960-maas-api-tls\") pod \"maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:17.316501 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.316405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swzkb\" (UniqueName: \"kubernetes.io/projected/5b0fb19e-4509-4f95-8ed6-1954331df960-kube-api-access-swzkb\") pod \"maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:17.316587 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:58:17.316554    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-serving-cert: secret "maas-api-e2e-shared-b-f937a7-serving-cert" not found
Jul 10 21:58:17.316657 ip-10-0-141-131 kubenswrapper[2575]: E0710 21:58:17.316623    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b0fb19e-4509-4f95-8ed6-1954331df960-maas-api-tls podName:5b0fb19e-4509-4f95-8ed6-1954331df960 nodeName:}" failed. No retries permitted until 2026-07-10 21:58:17.816602814 +0000 UTC m=+2223.449848050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5b0fb19e-4509-4f95-8ed6-1954331df960-maas-api-tls") pod "maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r" (UID: "5b0fb19e-4509-4f95-8ed6-1954331df960") : secret "maas-api-e2e-shared-b-f937a7-serving-cert" not found
Jul 10 21:58:17.316732 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.316656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b0fb19e-4509-4f95-8ed6-1954331df960-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:17.317384 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.317362    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b0fb19e-4509-4f95-8ed6-1954331df960-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:17.327612 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.327588    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swzkb\" (UniqueName: \"kubernetes.io/projected/5b0fb19e-4509-4f95-8ed6-1954331df960-kube-api-access-swzkb\") pod \"maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:17.452099 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.451997    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:17.820259 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.820125    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b0fb19e-4509-4f95-8ed6-1954331df960-maas-api-tls\") pod \"maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:17.822787 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.822763    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b0fb19e-4509-4f95-8ed6-1954331df960-maas-api-tls\") pod \"maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:17.873180 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.873146    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:17.973543 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:17.973504    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:18.114521 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:18.114483    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:18.260698 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:18.260671    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"]
Jul 10 21:58:18.262837 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:58:18.262806    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0fb19e_4509_4f95_8ed6_1954331df960.slice/crio-bd376e6e52cc13067621b99d0f7a5946e5789f56032fe42472700cc9d794fa2b WatchSource:0}: Error finding container bd376e6e52cc13067621b99d0f7a5946e5789f56032fe42472700cc9d794fa2b: Status 404 returned error can't find the container with id bd376e6e52cc13067621b99d0f7a5946e5789f56032fe42472700cc9d794fa2b
Jul 10 21:58:19.198545 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:19.198510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r" event={"ID":"5b0fb19e-4509-4f95-8ed6-1954331df960","Type":"ContainerStarted","Data":"91b1cbc03b8bb4866bdcb6d7b91131a289973d98f03c904650b76fcbe603589b"}
Jul 10 21:58:19.198746 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:19.198567    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r" event={"ID":"5b0fb19e-4509-4f95-8ed6-1954331df960","Type":"ContainerStarted","Data":"bd376e6e52cc13067621b99d0f7a5946e5789f56032fe42472700cc9d794fa2b"}
Jul 10 21:58:19.198746 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:19.198594    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:19.216487 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:19.216437    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r" podStartSLOduration=1.754818218 podStartE2EDuration="2.216422316s" totalImagesPullingTime="461.604098ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:58:19.214479712 +0000 UTC m=+2224.847724978" watchObservedRunningTime="2026-07-10 21:58:19.216422316 +0000 UTC m=+2224.849667606"
Jul 10 21:58:21.591072 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:21.591022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:23.094442 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:23.094406    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:58:25.210347 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:25.210321    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 21:58:30.844427 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:30.844389    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:30.944908 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:30.944873    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:31.180691 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:31.180598    2575 patch_prober.go:28] interesting pod/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 10 21:58:31.180691 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:31.180668    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h" podUID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 10 21:58:31.273444 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:31.273384    2575 generic.go:356] "Generic (PLEG): container finished" podID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerID="a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f" exitCode=0
Jul 10 21:58:31.273627 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:31.273454    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h" event={"ID":"b72d7d00-4660-4bfb-8bd8-90b273cc70d0","Type":"ContainerDied","Data":"a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f"}
Jul 10 21:58:31.273909 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:31.273893    2575 scope.go:117] "RemoveContainer" containerID="a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f"
Jul 10 21:58:31.274882 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:31.274853    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:58:31.274973 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:31.274918    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:58:31.274973 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:31.274966    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 10 21:58:32.281513 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:32.281483    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h" event={"ID":"b72d7d00-4660-4bfb-8bd8-90b273cc70d0","Type":"ContainerStarted","Data":"807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99"}
Jul 10 21:58:33.174674 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:33.174630    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:33.174879 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:33.174856    2575 patch_prober.go:28] interesting pod/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 10 21:58:33.174940 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:33.174911    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h" podUID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 10 21:58:34.174685 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:34.174652    2575 patch_prober.go:28] interesting pod/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 10 21:58:34.175077 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:34.174703    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h" podUID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 10 21:58:35.174618 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:35.174577    2575 patch_prober.go:28] interesting pod/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 10 21:58:35.174798 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:35.174634    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h" podUID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 10 21:58:36.188501 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:36.188422    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:36.189025 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:36.188699    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:36.189367 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:36.189351    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 21:58:38.740625 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:38.740575    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:38.840970 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:38.840929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:39.200528 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.200490    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"]
Jul 10 21:58:39.204168 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.204145    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.207773 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.207746    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-22d37c\"/\"kube-root-ca.crt\""
Jul 10 21:58:39.207908 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.207797    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-22d37c\"/\"openshift-service-ca.crt\""
Jul 10 21:58:39.207908 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.207747    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-22d37c\"/\"default-dockercfg-ldfrm\""
Jul 10 21:58:39.208121 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.208107    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-22d37c\"/\"auth-test-model-22d37c-kserve-self-signed-certs\""
Jul 10 21:58:39.211473 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.211451    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"]
Jul 10 21:58:39.230660 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.230617    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:58:39.322310 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.322259    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldnnp\" (UniqueName: \"kubernetes.io/projected/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-kube-api-access-ldnnp\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.322505 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.322331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-tmp-dir\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.322505 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.322362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-dshm\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.322505 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.322454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-model-cache\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.322505 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.322487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-home\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.322672 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.322514    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-tls-certs\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.423251 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.423215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-dshm\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.423439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.423303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-model-cache\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.423439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.423325    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-home\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.423439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.423354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-tls-certs\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.423439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.423390    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldnnp\" (UniqueName: \"kubernetes.io/projected/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-kube-api-access-ldnnp\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.423439 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.423438    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-tmp-dir\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.423713 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.423686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-model-cache\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.423767 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.423738    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-home\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.423806 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.423780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-tmp-dir\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.425573 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.425554    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-dshm\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.425855 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.425839    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-tls-certs\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.430704 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.430685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldnnp\" (UniqueName: \"kubernetes.io/projected/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-kube-api-access-ldnnp\") pod \"auth-test-model-22d37c-kserve-677d4698f9-t2pm9\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") " pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.515801 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.515710    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:39.656871 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:39.656844    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"]
Jul 10 21:58:39.658680 ip-10-0-141-131 kubenswrapper[2575]: W0710 21:58:39.658650    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd11159e5_cfa2_49d3_816d_2d2bc8bfe25c.slice/crio-2b6d85f3a58a43f09204b7f1dd63218c4daa0f01edd6d79aeca5ede78c445839 WatchSource:0}: Error finding container 2b6d85f3a58a43f09204b7f1dd63218c4daa0f01edd6d79aeca5ede78c445839: Status 404 returned error can't find the container with id 2b6d85f3a58a43f09204b7f1dd63218c4daa0f01edd6d79aeca5ede78c445839
Jul 10 21:58:40.323699 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:40.323665    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9" event={"ID":"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c","Type":"ContainerStarted","Data":"78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6"}
Jul 10 21:58:40.324074 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:40.323707    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9" event={"ID":"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c","Type":"ContainerStarted","Data":"2b6d85f3a58a43f09204b7f1dd63218c4daa0f01edd6d79aeca5ede78c445839"}
Jul 10 21:58:40.345693 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:40.345639    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9" podStartSLOduration=1.345624383 podStartE2EDuration="1.345624383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:58:40.34268103 +0000 UTC m=+2245.975926283" watchObservedRunningTime="2026-07-10 21:58:40.345624383 +0000 UTC m=+2245.978869638"
Jul 10 21:58:42.396642 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:42.396604    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:58:49.516134 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:49.516082    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:49.516134 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:49.516139    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:49.529208 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:49.529175    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:58:50.390907 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:58:50.390877    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 21:59:00.993939 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:59:00.993905    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:59:05.294763 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:59:05.294729    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:59:13.367416 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:59:13.367378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:59:20.502086 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:59:20.502001    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:59:39.397970 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:59:39.397936    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 21:59:44.986203 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:59:44.986155    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:59:45.086450 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:59:45.086407    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 21:59:54.228677 ip-10-0-141-131 kubenswrapper[2575]: I0710 21:59:54.228631    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:00:14.240730 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:00:14.240631    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:00:15.736424 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:00:15.736392    2575 scope.go:117] "RemoveContainer" containerID="6bc122a88bf47fe930b4cdd37810d1ec4f5db7f8d665d10e645719b549a2f864"
Jul 10 22:00:33.136971 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:00:33.136934    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:00:52.550072 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:00:52.550036    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:00:56.813591 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:00:56.813554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:01:07.318430 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:07.318396    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"]
Jul 10 22:01:07.337129 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:07.337090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:01:08.375390 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:08.375355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:01:11.642710 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:11.642670    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:01:15.666253 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:15.666228    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 22:01:15.676636 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:15.676612    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9lqx_9240b000-df62-4dd5-8d6b-a3ca3e838b6d/ovn-acl-logging/0.log"
Jul 10 22:01:17.259593 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.259552    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"]
Jul 10 22:01:17.262991 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.262970    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.266886 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.266861    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-22d37c\"/\"sub-test-model-22d37c-kserve-self-signed-certs\""
Jul 10 22:01:17.309671 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.309628    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"]
Jul 10 22:01:17.339725 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.339692    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj8pr\" (UniqueName: \"kubernetes.io/projected/8015a8ff-6d61-48b4-b81f-14977bd67900-kube-api-access-hj8pr\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.339907 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.339731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-home\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.339907 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.339754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-dshm\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.339907 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.339774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-tmp-dir\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.339907 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.339869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-model-cache\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.340149 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.339956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8015a8ff-6d61-48b4-b81f-14977bd67900-tls-certs\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.440574 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.440532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj8pr\" (UniqueName: \"kubernetes.io/projected/8015a8ff-6d61-48b4-b81f-14977bd67900-kube-api-access-hj8pr\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.440574 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.440585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-home\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.440836 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.440613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-dshm\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.440836 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.440635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-tmp-dir\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.440836 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.440676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-model-cache\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.440836 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.440739    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8015a8ff-6d61-48b4-b81f-14977bd67900-tls-certs\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.441099 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.441065    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-home\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.441099 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.441080    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-tmp-dir\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.441299 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.441168    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-model-cache\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.443029 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.443007    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-dshm\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.443212 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.443196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8015a8ff-6d61-48b4-b81f-14977bd67900-tls-certs\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.464147 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.464107    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:01:17.464805 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.464785    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj8pr\" (UniqueName: \"kubernetes.io/projected/8015a8ff-6d61-48b4-b81f-14977bd67900-kube-api-access-hj8pr\") pod \"sub-test-model-22d37c-kserve-5788789d6f-j9ct9\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") " pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.572577 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.572485    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:17.747572 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:17.747541    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"]
Jul 10 22:01:17.749032 ip-10-0-141-131 kubenswrapper[2575]: W0710 22:01:17.749005    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8015a8ff_6d61_48b4_b81f_14977bd67900.slice/crio-e6467edfa25aff0dbda9097059300d506d95305712177a2d6ca42da14647822a WatchSource:0}: Error finding container e6467edfa25aff0dbda9097059300d506d95305712177a2d6ca42da14647822a: Status 404 returned error can't find the container with id e6467edfa25aff0dbda9097059300d506d95305712177a2d6ca42da14647822a
Jul 10 22:01:18.184548 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:18.184509    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9" event={"ID":"8015a8ff-6d61-48b4-b81f-14977bd67900","Type":"ContainerStarted","Data":"e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0"}
Jul 10 22:01:18.184548 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:18.184547    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9" event={"ID":"8015a8ff-6d61-48b4-b81f-14977bd67900","Type":"ContainerStarted","Data":"e6467edfa25aff0dbda9097059300d506d95305712177a2d6ca42da14647822a"}
Jul 10 22:01:18.221410 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:18.221357    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9" podStartSLOduration=1.22133935 podStartE2EDuration="1.22133935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:01:18.220201581 +0000 UTC m=+2403.853446836" watchObservedRunningTime="2026-07-10 22:01:18.22133935 +0000 UTC m=+2403.854584604"
Jul 10 22:01:22.341118 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.341079    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9" podUID="d11159e5-cfa2-49d3-816d-2d2bc8bfe25c" containerName="main" containerID="cri-o://78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6" gracePeriod=45
Jul 10 22:01:22.594535 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.594474    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 22:01:22.693124 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.693091    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-model-cache\") pod \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") "
Jul 10 22:01:22.693336 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.693196    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-tls-certs\") pod \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") "
Jul 10 22:01:22.693336 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.693230    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldnnp\" (UniqueName: \"kubernetes.io/projected/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-kube-api-access-ldnnp\") pod \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") "
Jul 10 22:01:22.693336 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.693326    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-home\") pod \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") "
Jul 10 22:01:22.693491 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.693406    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-tmp-dir\") pod \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") "
Jul 10 22:01:22.693491 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.693428    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-model-cache" (OuterVolumeSpecName: "model-cache") pod "d11159e5-cfa2-49d3-816d-2d2bc8bfe25c" (UID: "d11159e5-cfa2-49d3-816d-2d2bc8bfe25c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:01:22.693491 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.693437    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-dshm\") pod \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\" (UID: \"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c\") "
Jul 10 22:01:22.693678 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.693650    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-home" (OuterVolumeSpecName: "home") pod "d11159e5-cfa2-49d3-816d-2d2bc8bfe25c" (UID: "d11159e5-cfa2-49d3-816d-2d2bc8bfe25c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:01:22.693755 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.693678    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d11159e5-cfa2-49d3-816d-2d2bc8bfe25c" (UID: "d11159e5-cfa2-49d3-816d-2d2bc8bfe25c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:01:22.693812 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.693801    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-home\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:01:22.693865 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.693817    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-tmp-dir\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:01:22.693865 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.693828    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-model-cache\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:01:22.695462 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.695433    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d11159e5-cfa2-49d3-816d-2d2bc8bfe25c" (UID: "d11159e5-cfa2-49d3-816d-2d2bc8bfe25c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:01:22.695462 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.695447    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-dshm" (OuterVolumeSpecName: "dshm") pod "d11159e5-cfa2-49d3-816d-2d2bc8bfe25c" (UID: "d11159e5-cfa2-49d3-816d-2d2bc8bfe25c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:01:22.695604 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.695468    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-kube-api-access-ldnnp" (OuterVolumeSpecName: "kube-api-access-ldnnp") pod "d11159e5-cfa2-49d3-816d-2d2bc8bfe25c" (UID: "d11159e5-cfa2-49d3-816d-2d2bc8bfe25c"). InnerVolumeSpecName "kube-api-access-ldnnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:01:22.795333 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.795261    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-tls-certs\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:01:22.795333 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.795324    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldnnp\" (UniqueName: \"kubernetes.io/projected/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-kube-api-access-ldnnp\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:01:22.795333 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:22.795334    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c-dshm\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:01:23.212664 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:23.212632    2575 generic.go:356] "Generic (PLEG): container finished" podID="d11159e5-cfa2-49d3-816d-2d2bc8bfe25c" containerID="78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6" exitCode=0
Jul 10 22:01:23.212880 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:23.212674    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"
Jul 10 22:01:23.212880 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:23.212717    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9" event={"ID":"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c","Type":"ContainerDied","Data":"78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6"}
Jul 10 22:01:23.212880 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:23.212765    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9" event={"ID":"d11159e5-cfa2-49d3-816d-2d2bc8bfe25c","Type":"ContainerDied","Data":"2b6d85f3a58a43f09204b7f1dd63218c4daa0f01edd6d79aeca5ede78c445839"}
Jul 10 22:01:23.212880 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:23.212786    2575 scope.go:117] "RemoveContainer" containerID="78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6"
Jul 10 22:01:23.222400 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:23.222378    2575 scope.go:117] "RemoveContainer" containerID="78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6"
Jul 10 22:01:23.222642 ip-10-0-141-131 kubenswrapper[2575]: E0710 22:01:23.222621    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6\": container with ID starting with 78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6 not found: ID does not exist" containerID="78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6"
Jul 10 22:01:23.222687 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:23.222651    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6"} err="failed to get container status \"78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6\": rpc error: code = NotFound desc = could not find container \"78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6\": container with ID starting with 78a09b84178efeb124bc7828f1f1c5517092fc6ad8ed939275b9f7883a0ac2b6 not found: ID does not exist"
Jul 10 22:01:23.242496 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:23.242463    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"]
Jul 10 22:01:23.248367 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:23.248336    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/auth-test-model-22d37c-kserve-677d4698f9-t2pm9"]
Jul 10 22:01:23.523233 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:23.523154    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d11159e5-cfa2-49d3-816d-2d2bc8bfe25c" path="/var/lib/kubelet/pods/d11159e5-cfa2-49d3-816d-2d2bc8bfe25c/volumes"
Jul 10 22:01:27.573437 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:27.573399    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:27.573437 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:27.573449    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:27.586413 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:27.586385    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:28.252517 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:28.252488    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:01:28.665038 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:28.665003    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:01:40.578617 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:40.578520    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:01:45.627368 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:01:45.627332    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:02:01.015290 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:01.015227    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:02:19.239613 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:19.239580    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"]
Jul 10 22:02:19.301917 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:19.301871    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:02:20.291333 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:20.291258    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:02:22.744955 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:22.744919    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:02:34.259414 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.259354    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9" podUID="8015a8ff-6d61-48b4-b81f-14977bd67900" containerName="main" containerID="cri-o://e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0" gracePeriod=45
Jul 10 22:02:34.511355 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.511296    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:02:34.614152 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.614111    2575 generic.go:356] "Generic (PLEG): container finished" podID="8015a8ff-6d61-48b4-b81f-14977bd67900" containerID="e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0" exitCode=0
Jul 10 22:02:34.614152 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.614157    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9" event={"ID":"8015a8ff-6d61-48b4-b81f-14977bd67900","Type":"ContainerDied","Data":"e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0"}
Jul 10 22:02:34.614500 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.614167    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"
Jul 10 22:02:34.614500 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.614194    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9" event={"ID":"8015a8ff-6d61-48b4-b81f-14977bd67900","Type":"ContainerDied","Data":"e6467edfa25aff0dbda9097059300d506d95305712177a2d6ca42da14647822a"}
Jul 10 22:02:34.614500 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.614211    2575 scope.go:117] "RemoveContainer" containerID="e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0"
Jul 10 22:02:34.623026 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.623008    2575 scope.go:117] "RemoveContainer" containerID="e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0"
Jul 10 22:02:34.623306 ip-10-0-141-131 kubenswrapper[2575]: E0710 22:02:34.623265    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0\": container with ID starting with e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0 not found: ID does not exist" containerID="e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0"
Jul 10 22:02:34.623360 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.623317    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0"} err="failed to get container status \"e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0\": rpc error: code = NotFound desc = could not find container \"e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0\": container with ID starting with e2fb213bd1e13576f4de95a9775b7f038e2e661345afdb27935ea16cf2e63cc0 not found: ID does not exist"
Jul 10 22:02:34.627581 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.627562    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-dshm\") pod \"8015a8ff-6d61-48b4-b81f-14977bd67900\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") "
Jul 10 22:02:34.627628 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.627597    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-tmp-dir\") pod \"8015a8ff-6d61-48b4-b81f-14977bd67900\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") "
Jul 10 22:02:34.627628 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.627620    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8015a8ff-6d61-48b4-b81f-14977bd67900-tls-certs\") pod \"8015a8ff-6d61-48b4-b81f-14977bd67900\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") "
Jul 10 22:02:34.627727 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.627655    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-home\") pod \"8015a8ff-6d61-48b4-b81f-14977bd67900\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") "
Jul 10 22:02:34.627727 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.627712    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj8pr\" (UniqueName: \"kubernetes.io/projected/8015a8ff-6d61-48b4-b81f-14977bd67900-kube-api-access-hj8pr\") pod \"8015a8ff-6d61-48b4-b81f-14977bd67900\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") "
Jul 10 22:02:34.627837 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.627730    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-model-cache\") pod \"8015a8ff-6d61-48b4-b81f-14977bd67900\" (UID: \"8015a8ff-6d61-48b4-b81f-14977bd67900\") "
Jul 10 22:02:34.627897 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.627822    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8015a8ff-6d61-48b4-b81f-14977bd67900" (UID: "8015a8ff-6d61-48b4-b81f-14977bd67900"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:02:34.628020 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.627996    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-home" (OuterVolumeSpecName: "home") pod "8015a8ff-6d61-48b4-b81f-14977bd67900" (UID: "8015a8ff-6d61-48b4-b81f-14977bd67900"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:02:34.628088 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.628019    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-tmp-dir\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:02:34.628088 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.628020    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-model-cache" (OuterVolumeSpecName: "model-cache") pod "8015a8ff-6d61-48b4-b81f-14977bd67900" (UID: "8015a8ff-6d61-48b4-b81f-14977bd67900"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:02:34.629705 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.629678    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8015a8ff-6d61-48b4-b81f-14977bd67900-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8015a8ff-6d61-48b4-b81f-14977bd67900" (UID: "8015a8ff-6d61-48b4-b81f-14977bd67900"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:02:34.629786 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.629707    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-dshm" (OuterVolumeSpecName: "dshm") pod "8015a8ff-6d61-48b4-b81f-14977bd67900" (UID: "8015a8ff-6d61-48b4-b81f-14977bd67900"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:02:34.629825 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.629773    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8015a8ff-6d61-48b4-b81f-14977bd67900-kube-api-access-hj8pr" (OuterVolumeSpecName: "kube-api-access-hj8pr") pod "8015a8ff-6d61-48b4-b81f-14977bd67900" (UID: "8015a8ff-6d61-48b4-b81f-14977bd67900"). InnerVolumeSpecName "kube-api-access-hj8pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:02:34.729085 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.729054    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-dshm\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:02:34.729085 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.729083    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8015a8ff-6d61-48b4-b81f-14977bd67900-tls-certs\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:02:34.729085 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.729092    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-home\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:02:34.729348 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.729101    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj8pr\" (UniqueName: \"kubernetes.io/projected/8015a8ff-6d61-48b4-b81f-14977bd67900-kube-api-access-hj8pr\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:02:34.729348 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.729110    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8015a8ff-6d61-48b4-b81f-14977bd67900-model-cache\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:02:34.948337 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.948304    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"]
Jul 10 22:02:34.965629 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:34.965602    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/sub-test-model-22d37c-kserve-5788789d6f-j9ct9"]
Jul 10 22:02:35.522875 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:35.522844    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8015a8ff-6d61-48b4-b81f-14977bd67900" path="/var/lib/kubelet/pods/8015a8ff-6d61-48b4-b81f-14977bd67900/volumes"
Jul 10 22:02:42.540784 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.540753    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"]
Jul 10 22:02:42.541177 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.541117    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8015a8ff-6d61-48b4-b81f-14977bd67900" containerName="main"
Jul 10 22:02:42.541177 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.541127    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8015a8ff-6d61-48b4-b81f-14977bd67900" containerName="main"
Jul 10 22:02:42.541177 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.541144    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d11159e5-cfa2-49d3-816d-2d2bc8bfe25c" containerName="main"
Jul 10 22:02:42.541177 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.541149    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d11159e5-cfa2-49d3-816d-2d2bc8bfe25c" containerName="main"
Jul 10 22:02:42.541351 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.541213    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d11159e5-cfa2-49d3-816d-2d2bc8bfe25c" containerName="main"
Jul 10 22:02:42.541351 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.541222    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8015a8ff-6d61-48b4-b81f-14977bd67900" containerName="main"
Jul 10 22:02:42.545558 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.545537    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.549181 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.549160    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-22d37c\"/\"kube-root-ca.crt\""
Jul 10 22:02:42.549306 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.549216    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-22d37c\"/\"openshift-service-ca.crt\""
Jul 10 22:02:42.549306 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.549230    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-22d37c\"/\"rate-test-model-22d37c-kserve-self-signed-certs\""
Jul 10 22:02:42.550508 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.550492    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-22d37c\"/\"default-dockercfg-ldfrm\""
Jul 10 22:02:42.561407 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.561372    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"]
Jul 10 22:02:42.601637 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.601607    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7qhp\" (UniqueName: \"kubernetes.io/projected/a8f90a22-606d-406f-a624-56a964ffd6ae-kube-api-access-c7qhp\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.601812 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.601641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f90a22-606d-406f-a624-56a964ffd6ae-tls-certs\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.601812 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.601679    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-tmp-dir\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.601895 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.601814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-dshm\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.601895 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.601845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-home\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.601981 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.601923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-model-cache\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.624201 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.624169    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:02:42.702401 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.702367    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-dshm\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.702401 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.702406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-home\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.702653 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.702453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-model-cache\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.702653 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.702477    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qhp\" (UniqueName: \"kubernetes.io/projected/a8f90a22-606d-406f-a624-56a964ffd6ae-kube-api-access-c7qhp\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.702653 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.702494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f90a22-606d-406f-a624-56a964ffd6ae-tls-certs\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.702653 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.702607    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-tmp-dir\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.702932 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.702909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-model-cache\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.703021 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.702917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-home\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.703021 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.702984    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-tmp-dir\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.704740 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.704711    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-dshm\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.705107 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.705088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f90a22-606d-406f-a624-56a964ffd6ae-tls-certs\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.711722 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.711697    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7qhp\" (UniqueName: \"kubernetes.io/projected/a8f90a22-606d-406f-a624-56a964ffd6ae-kube-api-access-c7qhp\") pod \"rate-test-model-22d37c-kserve-5f5667dbd7-llq9m\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") " pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.854377 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.854341    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:42.990320 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:42.990291    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"]
Jul 10 22:02:42.991641 ip-10-0-141-131 kubenswrapper[2575]: W0710 22:02:42.991613    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8f90a22_606d_406f_a624_56a964ffd6ae.slice/crio-fc3ad09d42e455dbf754d8bd2f608ec86c0e9ccd4d6ee3ecd112216118707dd7 WatchSource:0}: Error finding container fc3ad09d42e455dbf754d8bd2f608ec86c0e9ccd4d6ee3ecd112216118707dd7: Status 404 returned error can't find the container with id fc3ad09d42e455dbf754d8bd2f608ec86c0e9ccd4d6ee3ecd112216118707dd7
Jul 10 22:02:43.668208 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:43.668172    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m" event={"ID":"a8f90a22-606d-406f-a624-56a964ffd6ae","Type":"ContainerStarted","Data":"22f6991eb429d7eadc0d171689e927f2321d9da7fccc7e1eaa328344f7253b97"}
Jul 10 22:02:43.668208 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:43.668211    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m" event={"ID":"a8f90a22-606d-406f-a624-56a964ffd6ae","Type":"ContainerStarted","Data":"fc3ad09d42e455dbf754d8bd2f608ec86c0e9ccd4d6ee3ecd112216118707dd7"}
Jul 10 22:02:43.687634 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:43.687581    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m" podStartSLOduration=1.687564521 podStartE2EDuration="1.687564521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:02:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:02:43.685200086 +0000 UTC m=+2489.318445339" watchObservedRunningTime="2026-07-10 22:02:43.687564521 +0000 UTC m=+2489.320809774"
Jul 10 22:02:46.716535 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:46.716497    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:02:52.854869 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:52.854822    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:52.854869 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:52.854881    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:52.867305 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:52.867259    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:53.734115 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:53.734084    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:02:56.965638 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:02:56.965601    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:03:15.756591 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:03:15.756504    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:03:17.488015 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:03:17.487958    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:03:17.585833 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:03:17.585798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:03:20.496861 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:03:20.496765    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:03:31.679764 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:03:31.679731    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:03:32.780093 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:03:32.780053    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:03:39.508817 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:03:39.508775    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:03:39.611485 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:03:39.611453    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:03:49.105030 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:03:49.104990    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:04:05.599902 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:05.599864    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:04:13.066314 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:13.066249    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"]
Jul 10 22:04:13.084849 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:13.084817    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:04:13.903238 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:13.903186    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:04:14.824530 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:14.824496    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7184-139850073854640"]
Jul 10 22:04:14.828122 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:14.828100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850073854640"
Jul 10 22:04:14.830839 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:14.830822    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-p72xp\""
Jul 10 22:04:14.834801 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:14.834777    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7184-139850073854640"]
Jul 10 22:04:14.942943 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:14.942904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58v9h\" (UniqueName: \"kubernetes.io/projected/ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5-kube-api-access-58v9h\") pod \"test-curl-7184-139850073854640\" (UID: \"ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5\") " pod="openshift-ingress/test-curl-7184-139850073854640"
Jul 10 22:04:15.043943 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:15.043908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58v9h\" (UniqueName: \"kubernetes.io/projected/ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5-kube-api-access-58v9h\") pod \"test-curl-7184-139850073854640\" (UID: \"ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5\") " pod="openshift-ingress/test-curl-7184-139850073854640"
Jul 10 22:04:15.052438 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:15.052409    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58v9h\" (UniqueName: \"kubernetes.io/projected/ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5-kube-api-access-58v9h\") pod \"test-curl-7184-139850073854640\" (UID: \"ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5\") " pod="openshift-ingress/test-curl-7184-139850073854640"
Jul 10 22:04:15.139646 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:15.139601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850073854640"
Jul 10 22:04:15.278782 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:15.278757    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7184-139850073854640"]
Jul 10 22:04:15.279982 ip-10-0-141-131 kubenswrapper[2575]: W0710 22:04:15.279958    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac756d3b_1c44_4e3b_97b3_ae7455c0dbc5.slice/crio-4e3d52bc88b174ee06c0ef8a380529d50eab8fd348bc23bd315dc1a6521716ef WatchSource:0}: Error finding container 4e3d52bc88b174ee06c0ef8a380529d50eab8fd348bc23bd315dc1a6521716ef: Status 404 returned error can't find the container with id 4e3d52bc88b174ee06c0ef8a380529d50eab8fd348bc23bd315dc1a6521716ef
Jul 10 22:04:15.281378 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:15.281362    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 22:04:16.166837 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:16.166792    2575 generic.go:356] "Generic (PLEG): container finished" podID="ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5" containerID="7be74554cc56c7f22d8b71ff81318734ccfa5190d45130e9497bf3955b9db056" exitCode=0
Jul 10 22:04:16.167250 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:16.166894    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7184-139850073854640" event={"ID":"ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5","Type":"ContainerDied","Data":"7be74554cc56c7f22d8b71ff81318734ccfa5190d45130e9497bf3955b9db056"}
Jul 10 22:04:16.167250 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:16.166938    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7184-139850073854640" event={"ID":"ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5","Type":"ContainerStarted","Data":"4e3d52bc88b174ee06c0ef8a380529d50eab8fd348bc23bd315dc1a6521716ef"}
Jul 10 22:04:17.322794 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.322770    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850073854640"
Jul 10 22:04:17.343890 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.343849    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7184-139850073854640_ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5/test-curl-7184-139850073854640/0.log"
Jul 10 22:04:17.364925 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.364888    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58v9h\" (UniqueName: \"kubernetes.io/projected/ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5-kube-api-access-58v9h\") pod \"ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5\" (UID: \"ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5\") "
Jul 10 22:04:17.367149 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.367124    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5-kube-api-access-58v9h" (OuterVolumeSpecName: "kube-api-access-58v9h") pod "ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5" (UID: "ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5"). InnerVolumeSpecName "kube-api-access-58v9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:04:17.367916 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.367894    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7184-139850073854640"]
Jul 10 22:04:17.371579 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.371553    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7184-139850073854640"]
Jul 10 22:04:17.466067 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.465982    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58v9h\" (UniqueName: \"kubernetes.io/projected/ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5-kube-api-access-58v9h\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:17.488203 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.488167    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7184-139850074065584"]
Jul 10 22:04:17.488622 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.488607    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5" containerName="test-curl-7184-139850073854640"
Jul 10 22:04:17.488672 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.488624    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5" containerName="test-curl-7184-139850073854640"
Jul 10 22:04:17.488711 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.488696    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5" containerName="test-curl-7184-139850073854640"
Jul 10 22:04:17.491692 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.491676    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850074065584"
Jul 10 22:04:17.496571 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.496545    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7184-139850074065584"]
Jul 10 22:04:17.523749 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.523722    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5" path="/var/lib/kubelet/pods/ac756d3b-1c44-4e3b-97b3-ae7455c0dbc5/volumes"
Jul 10 22:04:17.566959 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.566928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cwfp\" (UniqueName: \"kubernetes.io/projected/aae12f84-2a44-4362-aadf-016f84fd5b18-kube-api-access-2cwfp\") pod \"test-curl-7184-139850074065584\" (UID: \"aae12f84-2a44-4362-aadf-016f84fd5b18\") " pod="openshift-ingress/test-curl-7184-139850074065584"
Jul 10 22:04:17.668367 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.668337    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cwfp\" (UniqueName: \"kubernetes.io/projected/aae12f84-2a44-4362-aadf-016f84fd5b18-kube-api-access-2cwfp\") pod \"test-curl-7184-139850074065584\" (UID: \"aae12f84-2a44-4362-aadf-016f84fd5b18\") " pod="openshift-ingress/test-curl-7184-139850074065584"
Jul 10 22:04:17.676961 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.676928    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cwfp\" (UniqueName: \"kubernetes.io/projected/aae12f84-2a44-4362-aadf-016f84fd5b18-kube-api-access-2cwfp\") pod \"test-curl-7184-139850074065584\" (UID: \"aae12f84-2a44-4362-aadf-016f84fd5b18\") " pod="openshift-ingress/test-curl-7184-139850074065584"
Jul 10 22:04:17.802183 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.802095    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850074065584"
Jul 10 22:04:17.934652 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:17.934629    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7184-139850074065584"]
Jul 10 22:04:17.936110 ip-10-0-141-131 kubenswrapper[2575]: W0710 22:04:17.936081    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaae12f84_2a44_4362_aadf_016f84fd5b18.slice/crio-b2f72743d7badd84c83320f9501cfa4773e71fab4b45b6488f523af513f79e02 WatchSource:0}: Error finding container b2f72743d7badd84c83320f9501cfa4773e71fab4b45b6488f523af513f79e02: Status 404 returned error can't find the container with id b2f72743d7badd84c83320f9501cfa4773e71fab4b45b6488f523af513f79e02
Jul 10 22:04:18.178885 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:18.178859    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850073854640"
Jul 10 22:04:18.179070 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:18.178860    2575 scope.go:117] "RemoveContainer" containerID="7be74554cc56c7f22d8b71ff81318734ccfa5190d45130e9497bf3955b9db056"
Jul 10 22:04:18.180349 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:18.180246    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7184-139850074065584" event={"ID":"aae12f84-2a44-4362-aadf-016f84fd5b18","Type":"ContainerStarted","Data":"b2f72743d7badd84c83320f9501cfa4773e71fab4b45b6488f523af513f79e02"}
Jul 10 22:04:19.187882 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:19.187850    2575 generic.go:356] "Generic (PLEG): container finished" podID="aae12f84-2a44-4362-aadf-016f84fd5b18" containerID="9a5da733c877053868b6fa0a624e799e196123fe6671353a8eaf4d991c6f7772" exitCode=0
Jul 10 22:04:19.188308 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:19.187910    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7184-139850074065584" event={"ID":"aae12f84-2a44-4362-aadf-016f84fd5b18","Type":"ContainerDied","Data":"9a5da733c877053868b6fa0a624e799e196123fe6671353a8eaf4d991c6f7772"}
Jul 10 22:04:20.342449 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.342423    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850074065584"
Jul 10 22:04:20.364137 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.364088    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7184-139850074065584_aae12f84-2a44-4362-aadf-016f84fd5b18/test-curl-7184-139850074065584/0.log"
Jul 10 22:04:20.386000 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.385962    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7184-139850074065584"]
Jul 10 22:04:20.390336 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.390297    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7184-139850074065584"]
Jul 10 22:04:20.394009 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.393982    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cwfp\" (UniqueName: \"kubernetes.io/projected/aae12f84-2a44-4362-aadf-016f84fd5b18-kube-api-access-2cwfp\") pod \"aae12f84-2a44-4362-aadf-016f84fd5b18\" (UID: \"aae12f84-2a44-4362-aadf-016f84fd5b18\") "
Jul 10 22:04:20.396067 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.396011    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae12f84-2a44-4362-aadf-016f84fd5b18-kube-api-access-2cwfp" (OuterVolumeSpecName: "kube-api-access-2cwfp") pod "aae12f84-2a44-4362-aadf-016f84fd5b18" (UID: "aae12f84-2a44-4362-aadf-016f84fd5b18"). InnerVolumeSpecName "kube-api-access-2cwfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:04:20.495663 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.495611    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cwfp\" (UniqueName: \"kubernetes.io/projected/aae12f84-2a44-4362-aadf-016f84fd5b18-kube-api-access-2cwfp\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:20.551335 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.551294    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7184-139850079263600"]
Jul 10 22:04:20.551672 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.551660    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae12f84-2a44-4362-aadf-016f84fd5b18" containerName="test-curl-7184-139850074065584"
Jul 10 22:04:20.551720 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.551673    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae12f84-2a44-4362-aadf-016f84fd5b18" containerName="test-curl-7184-139850074065584"
Jul 10 22:04:20.551755 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.551734    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aae12f84-2a44-4362-aadf-016f84fd5b18" containerName="test-curl-7184-139850074065584"
Jul 10 22:04:20.554601 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.554584    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:20.560673 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.560646    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7184-139850079263600"]
Jul 10 22:04:20.698358 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.698238    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qxjq\" (UniqueName: \"kubernetes.io/projected/8f4f1551-1d3c-4148-8640-a04275c0b7f4-kube-api-access-6qxjq\") pod \"test-curl-7184-139850079263600\" (UID: \"8f4f1551-1d3c-4148-8640-a04275c0b7f4\") " pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:20.799898 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.799860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qxjq\" (UniqueName: \"kubernetes.io/projected/8f4f1551-1d3c-4148-8640-a04275c0b7f4-kube-api-access-6qxjq\") pod \"test-curl-7184-139850079263600\" (UID: \"8f4f1551-1d3c-4148-8640-a04275c0b7f4\") " pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:20.809012 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.808987    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qxjq\" (UniqueName: \"kubernetes.io/projected/8f4f1551-1d3c-4148-8640-a04275c0b7f4-kube-api-access-6qxjq\") pod \"test-curl-7184-139850079263600\" (UID: \"8f4f1551-1d3c-4148-8640-a04275c0b7f4\") " pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:20.865664 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:20.865623    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:21.001526 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:21.001494    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7184-139850079263600"]
Jul 10 22:04:21.003243 ip-10-0-141-131 kubenswrapper[2575]: W0710 22:04:21.003218    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f4f1551_1d3c_4148_8640_a04275c0b7f4.slice/crio-c49671abe4afd1a85d6ac201f230f0cc46a166e1e4bcb211a8dbf105e9579aeb WatchSource:0}: Error finding container c49671abe4afd1a85d6ac201f230f0cc46a166e1e4bcb211a8dbf105e9579aeb: Status 404 returned error can't find the container with id c49671abe4afd1a85d6ac201f230f0cc46a166e1e4bcb211a8dbf105e9579aeb
Jul 10 22:04:21.200170 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:21.200080    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850074065584"
Jul 10 22:04:21.200345 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:21.200090    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2f72743d7badd84c83320f9501cfa4773e71fab4b45b6488f523af513f79e02"
Jul 10 22:04:21.201349 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:21.201303    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7184-139850079263600" event={"ID":"8f4f1551-1d3c-4148-8640-a04275c0b7f4","Type":"ContainerStarted","Data":"c49671abe4afd1a85d6ac201f230f0cc46a166e1e4bcb211a8dbf105e9579aeb"}
Jul 10 22:04:21.211240 ip-10-0-141-131 kubenswrapper[2575]: E0710 22:04:21.211211    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7184-139850074065584\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="aae12f84-2a44-4362-aadf-016f84fd5b18" pod="openshift-ingress/test-curl-7184-139850074065584"
Jul 10 22:04:21.523515 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:21.523435    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aae12f84-2a44-4362-aadf-016f84fd5b18" path="/var/lib/kubelet/pods/aae12f84-2a44-4362-aadf-016f84fd5b18/volumes"
Jul 10 22:04:22.208360 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:22.208322    2575 generic.go:356] "Generic (PLEG): container finished" podID="8f4f1551-1d3c-4148-8640-a04275c0b7f4" containerID="2944c93cbf4971930e6dff5a33bd3245f63b6cc373aa355aa1ee99d7b772dbe2" exitCode=0
Jul 10 22:04:22.208542 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:22.208405    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7184-139850079263600" event={"ID":"8f4f1551-1d3c-4148-8640-a04275c0b7f4","Type":"ContainerDied","Data":"2944c93cbf4971930e6dff5a33bd3245f63b6cc373aa355aa1ee99d7b772dbe2"}
Jul 10 22:04:23.359919 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.359893    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:23.382808 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.382776    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7184-139850079263600_8f4f1551-1d3c-4148-8640-a04275c0b7f4/test-curl-7184-139850079263600/0.log"
Jul 10 22:04:23.406541 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.406499    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7184-139850079263600"]
Jul 10 22:04:23.411824 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.411795    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7184-139850079263600"]
Jul 10 22:04:23.422986 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.422962    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qxjq\" (UniqueName: \"kubernetes.io/projected/8f4f1551-1d3c-4148-8640-a04275c0b7f4-kube-api-access-6qxjq\") pod \"8f4f1551-1d3c-4148-8640-a04275c0b7f4\" (UID: \"8f4f1551-1d3c-4148-8640-a04275c0b7f4\") "
Jul 10 22:04:23.424999 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.424971    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f4f1551-1d3c-4148-8640-a04275c0b7f4-kube-api-access-6qxjq" (OuterVolumeSpecName: "kube-api-access-6qxjq") pod "8f4f1551-1d3c-4148-8640-a04275c0b7f4" (UID: "8f4f1551-1d3c-4148-8640-a04275c0b7f4"). InnerVolumeSpecName "kube-api-access-6qxjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:04:23.522980 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.522883    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f4f1551-1d3c-4148-8640-a04275c0b7f4" path="/var/lib/kubelet/pods/8f4f1551-1d3c-4148-8640-a04275c0b7f4/volumes"
Jul 10 22:04:23.523700 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.523677    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qxjq\" (UniqueName: \"kubernetes.io/projected/8f4f1551-1d3c-4148-8640-a04275c0b7f4-kube-api-access-6qxjq\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:23.528174 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.528144    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7184-139850079263600"]
Jul 10 22:04:23.528535 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.528520    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f4f1551-1d3c-4148-8640-a04275c0b7f4" containerName="test-curl-7184-139850079263600"
Jul 10 22:04:23.528535 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.528534    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f4f1551-1d3c-4148-8640-a04275c0b7f4" containerName="test-curl-7184-139850079263600"
Jul 10 22:04:23.528747 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.528603    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f4f1551-1d3c-4148-8640-a04275c0b7f4" containerName="test-curl-7184-139850079263600"
Jul 10 22:04:23.531490 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.531473    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:23.539315 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.539266    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7184-139850079263600"]
Jul 10 22:04:23.624854 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.624807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qx6k\" (UniqueName: \"kubernetes.io/projected/0ece540a-5577-4dcf-9f55-fb1b2873804a-kube-api-access-2qx6k\") pod \"test-curl-7184-139850079263600\" (UID: \"0ece540a-5577-4dcf-9f55-fb1b2873804a\") " pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:23.725698 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.725647    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qx6k\" (UniqueName: \"kubernetes.io/projected/0ece540a-5577-4dcf-9f55-fb1b2873804a-kube-api-access-2qx6k\") pod \"test-curl-7184-139850079263600\" (UID: \"0ece540a-5577-4dcf-9f55-fb1b2873804a\") " pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:23.734259 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.734231    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qx6k\" (UniqueName: \"kubernetes.io/projected/0ece540a-5577-4dcf-9f55-fb1b2873804a-kube-api-access-2qx6k\") pod \"test-curl-7184-139850079263600\" (UID: \"0ece540a-5577-4dcf-9f55-fb1b2873804a\") " pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:23.841375 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.841342    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:23.984942 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:23.984912    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7184-139850079263600"]
Jul 10 22:04:23.986694 ip-10-0-141-131 kubenswrapper[2575]: W0710 22:04:23.986654    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ece540a_5577_4dcf_9f55_fb1b2873804a.slice/crio-41b69000ff7551d909675ee88b6190f6275faa45c10d98ace3685d8dfbc35d61 WatchSource:0}: Error finding container 41b69000ff7551d909675ee88b6190f6275faa45c10d98ace3685d8dfbc35d61: Status 404 returned error can't find the container with id 41b69000ff7551d909675ee88b6190f6275faa45c10d98ace3685d8dfbc35d61
Jul 10 22:04:24.220634 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:24.220548    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:24.220634 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:24.220622    2575 scope.go:117] "RemoveContainer" containerID="2944c93cbf4971930e6dff5a33bd3245f63b6cc373aa355aa1ee99d7b772dbe2"
Jul 10 22:04:24.221946 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:24.221860    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7184-139850079263600" event={"ID":"0ece540a-5577-4dcf-9f55-fb1b2873804a","Type":"ContainerStarted","Data":"41b69000ff7551d909675ee88b6190f6275faa45c10d98ace3685d8dfbc35d61"}
Jul 10 22:04:25.236527 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:25.236493    2575 generic.go:356] "Generic (PLEG): container finished" podID="0ece540a-5577-4dcf-9f55-fb1b2873804a" containerID="0b753645a9c63c9f622842c451010e91b5dc80d50db4a8c1d047a54dba9e1eda" exitCode=0
Jul 10 22:04:25.236994 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:25.236576    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7184-139850079263600" event={"ID":"0ece540a-5577-4dcf-9f55-fb1b2873804a","Type":"ContainerDied","Data":"0b753645a9c63c9f622842c451010e91b5dc80d50db4a8c1d047a54dba9e1eda"}
Jul 10 22:04:25.499557 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:25.499463    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:04:26.393100 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.393076    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:26.416246 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.416139    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7184-139850079263600_0ece540a-5577-4dcf-9f55-fb1b2873804a/test-curl-7184-139850079263600/0.log"
Jul 10 22:04:26.445112 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.445070    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7184-139850079263600"]
Jul 10 22:04:26.455531 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.455491    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7184-139850079263600"]
Jul 10 22:04:26.554720 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.554634    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qx6k\" (UniqueName: \"kubernetes.io/projected/0ece540a-5577-4dcf-9f55-fb1b2873804a-kube-api-access-2qx6k\") pod \"0ece540a-5577-4dcf-9f55-fb1b2873804a\" (UID: \"0ece540a-5577-4dcf-9f55-fb1b2873804a\") "
Jul 10 22:04:26.556933 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.556902    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ece540a-5577-4dcf-9f55-fb1b2873804a-kube-api-access-2qx6k" (OuterVolumeSpecName: "kube-api-access-2qx6k") pod "0ece540a-5577-4dcf-9f55-fb1b2873804a" (UID: "0ece540a-5577-4dcf-9f55-fb1b2873804a"). InnerVolumeSpecName "kube-api-access-2qx6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:04:26.565692 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.565664    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7184-139850079264608"]
Jul 10 22:04:26.566057 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.566044    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ece540a-5577-4dcf-9f55-fb1b2873804a" containerName="test-curl-7184-139850079263600"
Jul 10 22:04:26.566101 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.566059    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ece540a-5577-4dcf-9f55-fb1b2873804a" containerName="test-curl-7184-139850079263600"
Jul 10 22:04:26.566136 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.566125    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ece540a-5577-4dcf-9f55-fb1b2873804a" containerName="test-curl-7184-139850079263600"
Jul 10 22:04:26.569037 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.569021    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:26.576067 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.575947    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7184-139850079264608"]
Jul 10 22:04:26.655625 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.655585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g95g4\" (UniqueName: \"kubernetes.io/projected/cf2f7658-6852-426d-aeee-907eb85c19dd-kube-api-access-g95g4\") pod \"test-curl-7184-139850079264608\" (UID: \"cf2f7658-6852-426d-aeee-907eb85c19dd\") " pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:26.655818 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.655781    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qx6k\" (UniqueName: \"kubernetes.io/projected/0ece540a-5577-4dcf-9f55-fb1b2873804a-kube-api-access-2qx6k\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:26.756843 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.756809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g95g4\" (UniqueName: \"kubernetes.io/projected/cf2f7658-6852-426d-aeee-907eb85c19dd-kube-api-access-g95g4\") pod \"test-curl-7184-139850079264608\" (UID: \"cf2f7658-6852-426d-aeee-907eb85c19dd\") " pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:26.768612 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.768588    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g95g4\" (UniqueName: \"kubernetes.io/projected/cf2f7658-6852-426d-aeee-907eb85c19dd-kube-api-access-g95g4\") pod \"test-curl-7184-139850079264608\" (UID: \"cf2f7658-6852-426d-aeee-907eb85c19dd\") " pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:26.878666 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:26.878627    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:27.009082 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:27.009056    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7184-139850079264608"]
Jul 10 22:04:27.010661 ip-10-0-141-131 kubenswrapper[2575]: W0710 22:04:27.010630    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf2f7658_6852_426d_aeee_907eb85c19dd.slice/crio-8a66b4521080ed9e3738ef706e8248096d5b0d35572ec8aac6db06534da74a19 WatchSource:0}: Error finding container 8a66b4521080ed9e3738ef706e8248096d5b0d35572ec8aac6db06534da74a19: Status 404 returned error can't find the container with id 8a66b4521080ed9e3738ef706e8248096d5b0d35572ec8aac6db06534da74a19
Jul 10 22:04:27.248406 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:27.248307    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7184-139850079264608" event={"ID":"cf2f7658-6852-426d-aeee-907eb85c19dd","Type":"ContainerStarted","Data":"8a66b4521080ed9e3738ef706e8248096d5b0d35572ec8aac6db06534da74a19"}
Jul 10 22:04:27.249542 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:27.249523    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41b69000ff7551d909675ee88b6190f6275faa45c10d98ace3685d8dfbc35d61"
Jul 10 22:04:27.249685 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:27.249552    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:27.259789 ip-10-0-141-131 kubenswrapper[2575]: E0710 22:04:27.259758    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7184-139850079263600\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="0ece540a-5577-4dcf-9f55-fb1b2873804a" pod="openshift-ingress/test-curl-7184-139850079263600"
Jul 10 22:04:27.523803 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:27.523699    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ece540a-5577-4dcf-9f55-fb1b2873804a" path="/var/lib/kubelet/pods/0ece540a-5577-4dcf-9f55-fb1b2873804a/volumes"
Jul 10 22:04:28.086779 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.086731    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m" podUID="a8f90a22-606d-406f-a624-56a964ffd6ae" containerName="main" containerID="cri-o://22f6991eb429d7eadc0d171689e927f2321d9da7fccc7e1eaa328344f7253b97" gracePeriod=45
Jul 10 22:04:28.259388 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.259355    2575 generic.go:356] "Generic (PLEG): container finished" podID="a8f90a22-606d-406f-a624-56a964ffd6ae" containerID="22f6991eb429d7eadc0d171689e927f2321d9da7fccc7e1eaa328344f7253b97" exitCode=0
Jul 10 22:04:28.259536 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.259436    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m" event={"ID":"a8f90a22-606d-406f-a624-56a964ffd6ae","Type":"ContainerDied","Data":"22f6991eb429d7eadc0d171689e927f2321d9da7fccc7e1eaa328344f7253b97"}
Jul 10 22:04:28.261232 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.261208    2575 generic.go:356] "Generic (PLEG): container finished" podID="cf2f7658-6852-426d-aeee-907eb85c19dd" containerID="190d0f447e0bcb215bd6befee94779db78bb03591a4427f16263e652e122c750" exitCode=0
Jul 10 22:04:28.261383 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.261252    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7184-139850079264608" event={"ID":"cf2f7658-6852-426d-aeee-907eb85c19dd","Type":"ContainerDied","Data":"190d0f447e0bcb215bd6befee94779db78bb03591a4427f16263e652e122c750"}
Jul 10 22:04:28.341348 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.341264    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:04:28.472849 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.472812    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f90a22-606d-406f-a624-56a964ffd6ae-tls-certs\") pod \"a8f90a22-606d-406f-a624-56a964ffd6ae\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") "
Jul 10 22:04:28.472849 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.472849    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-home\") pod \"a8f90a22-606d-406f-a624-56a964ffd6ae\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") "
Jul 10 22:04:28.473053 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.472897    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-tmp-dir\") pod \"a8f90a22-606d-406f-a624-56a964ffd6ae\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") "
Jul 10 22:04:28.473053 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.472936    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-model-cache\") pod \"a8f90a22-606d-406f-a624-56a964ffd6ae\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") "
Jul 10 22:04:28.473053 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.473005    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-dshm\") pod \"a8f90a22-606d-406f-a624-56a964ffd6ae\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") "
Jul 10 22:04:28.473053 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.473024    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7qhp\" (UniqueName: \"kubernetes.io/projected/a8f90a22-606d-406f-a624-56a964ffd6ae-kube-api-access-c7qhp\") pod \"a8f90a22-606d-406f-a624-56a964ffd6ae\" (UID: \"a8f90a22-606d-406f-a624-56a964ffd6ae\") "
Jul 10 22:04:28.473310 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.473152    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-home" (OuterVolumeSpecName: "home") pod "a8f90a22-606d-406f-a624-56a964ffd6ae" (UID: "a8f90a22-606d-406f-a624-56a964ffd6ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:04:28.473310 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.473221    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8f90a22-606d-406f-a624-56a964ffd6ae" (UID: "a8f90a22-606d-406f-a624-56a964ffd6ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:04:28.473310 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.473232    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8f90a22-606d-406f-a624-56a964ffd6ae" (UID: "a8f90a22-606d-406f-a624-56a964ffd6ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:04:28.474992 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.474970    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-dshm" (OuterVolumeSpecName: "dshm") pod "a8f90a22-606d-406f-a624-56a964ffd6ae" (UID: "a8f90a22-606d-406f-a624-56a964ffd6ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:04:28.475066 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.475033    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8f90a22-606d-406f-a624-56a964ffd6ae-kube-api-access-c7qhp" (OuterVolumeSpecName: "kube-api-access-c7qhp") pod "a8f90a22-606d-406f-a624-56a964ffd6ae" (UID: "a8f90a22-606d-406f-a624-56a964ffd6ae"). InnerVolumeSpecName "kube-api-access-c7qhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:04:28.475106 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.475066    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8f90a22-606d-406f-a624-56a964ffd6ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8f90a22-606d-406f-a624-56a964ffd6ae" (UID: "a8f90a22-606d-406f-a624-56a964ffd6ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:04:28.574085 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.574047    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-dshm\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:28.574085 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.574077    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7qhp\" (UniqueName: \"kubernetes.io/projected/a8f90a22-606d-406f-a624-56a964ffd6ae-kube-api-access-c7qhp\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:28.574085 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.574089    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f90a22-606d-406f-a624-56a964ffd6ae-tls-certs\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:28.574085 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.574099    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-home\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:28.574574 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.574107    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-tmp-dir\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:28.574574 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:28.574116    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f90a22-606d-406f-a624-56a964ffd6ae-model-cache\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:29.268578 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.268550    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"
Jul 10 22:04:29.268759 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.268590    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m" event={"ID":"a8f90a22-606d-406f-a624-56a964ffd6ae","Type":"ContainerDied","Data":"fc3ad09d42e455dbf754d8bd2f608ec86c0e9ccd4d6ee3ecd112216118707dd7"}
Jul 10 22:04:29.268759 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.268632    2575 scope.go:117] "RemoveContainer" containerID="22f6991eb429d7eadc0d171689e927f2321d9da7fccc7e1eaa328344f7253b97"
Jul 10 22:04:29.293403 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.293372    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"]
Jul 10 22:04:29.300412 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.299507    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-22d37c/rate-test-model-22d37c-kserve-5f5667dbd7-llq9m"]
Jul 10 22:04:29.417453 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.417429    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:29.441542 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.441516    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7184-139850079264608_cf2f7658-6852-426d-aeee-907eb85c19dd/test-curl-7184-139850079264608/0.log"
Jul 10 22:04:29.466854 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.466818    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7184-139850079264608"]
Jul 10 22:04:29.471281 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.471233    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7184-139850079264608"]
Jul 10 22:04:29.524221 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.524140    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8f90a22-606d-406f-a624-56a964ffd6ae" path="/var/lib/kubelet/pods/a8f90a22-606d-406f-a624-56a964ffd6ae/volumes"
Jul 10 22:04:29.585000 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.584957    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g95g4\" (UniqueName: \"kubernetes.io/projected/cf2f7658-6852-426d-aeee-907eb85c19dd-kube-api-access-g95g4\") pod \"cf2f7658-6852-426d-aeee-907eb85c19dd\" (UID: \"cf2f7658-6852-426d-aeee-907eb85c19dd\") "
Jul 10 22:04:29.587337 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.587307    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf2f7658-6852-426d-aeee-907eb85c19dd-kube-api-access-g95g4" (OuterVolumeSpecName: "kube-api-access-g95g4") pod "cf2f7658-6852-426d-aeee-907eb85c19dd" (UID: "cf2f7658-6852-426d-aeee-907eb85c19dd"). InnerVolumeSpecName "kube-api-access-g95g4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:04:29.593401 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.593379    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7184-139850079264608"]
Jul 10 22:04:29.593862 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.593841    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8f90a22-606d-406f-a624-56a964ffd6ae" containerName="main"
Jul 10 22:04:29.593862 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.593863    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8f90a22-606d-406f-a624-56a964ffd6ae" containerName="main"
Jul 10 22:04:29.594019 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.593891    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf2f7658-6852-426d-aeee-907eb85c19dd" containerName="test-curl-7184-139850079264608"
Jul 10 22:04:29.594019 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.593899    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf2f7658-6852-426d-aeee-907eb85c19dd" containerName="test-curl-7184-139850079264608"
Jul 10 22:04:29.594019 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.593995    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf2f7658-6852-426d-aeee-907eb85c19dd" containerName="test-curl-7184-139850079264608"
Jul 10 22:04:29.594019 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.594007    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8f90a22-606d-406f-a624-56a964ffd6ae" containerName="main"
Jul 10 22:04:29.601248 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.597757    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:29.604694 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.604670    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7184-139850079264608"]
Jul 10 22:04:29.686209 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.686178    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gql9b\" (UniqueName: \"kubernetes.io/projected/9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b-kube-api-access-gql9b\") pod \"test-curl-7184-139850079264608\" (UID: \"9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b\") " pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:29.686408 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.686308    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g95g4\" (UniqueName: \"kubernetes.io/projected/cf2f7658-6852-426d-aeee-907eb85c19dd-kube-api-access-g95g4\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:29.787678 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.787588    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gql9b\" (UniqueName: \"kubernetes.io/projected/9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b-kube-api-access-gql9b\") pod \"test-curl-7184-139850079264608\" (UID: \"9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b\") " pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:29.796535 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.796501    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gql9b\" (UniqueName: \"kubernetes.io/projected/9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b-kube-api-access-gql9b\") pod \"test-curl-7184-139850079264608\" (UID: \"9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b\") " pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:29.911549 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:29.911499    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:30.052996 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:30.052968    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7184-139850079264608"]
Jul 10 22:04:30.055497 ip-10-0-141-131 kubenswrapper[2575]: W0710 22:04:30.055461    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ef1dd6f_3667_42ed_b1d2_58d4bb8bbd6b.slice/crio-52d2e0ff7065f87dd5f474b7903a0f5b29fe46cde7216d95c026934e74eb9aed WatchSource:0}: Error finding container 52d2e0ff7065f87dd5f474b7903a0f5b29fe46cde7216d95c026934e74eb9aed: Status 404 returned error can't find the container with id 52d2e0ff7065f87dd5f474b7903a0f5b29fe46cde7216d95c026934e74eb9aed
Jul 10 22:04:30.275497 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:30.275470    2575 scope.go:117] "RemoveContainer" containerID="190d0f447e0bcb215bd6befee94779db78bb03591a4427f16263e652e122c750"
Jul 10 22:04:30.275677 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:30.275479    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:30.276888 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:30.276860    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7184-139850079264608" event={"ID":"9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b","Type":"ContainerStarted","Data":"52d2e0ff7065f87dd5f474b7903a0f5b29fe46cde7216d95c026934e74eb9aed"}
Jul 10 22:04:31.286201 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:31.286164    2575 generic.go:356] "Generic (PLEG): container finished" podID="9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b" containerID="5ac1dde120835c708d6b47b1a99e985beb1923c64ad3523de87d86337dc8d4b0" exitCode=0
Jul 10 22:04:31.286201 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:31.286203    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7184-139850079264608" event={"ID":"9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b","Type":"ContainerDied","Data":"5ac1dde120835c708d6b47b1a99e985beb1923c64ad3523de87d86337dc8d4b0"}
Jul 10 22:04:31.523760 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:31.523729    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf2f7658-6852-426d-aeee-907eb85c19dd" path="/var/lib/kubelet/pods/cf2f7658-6852-426d-aeee-907eb85c19dd/volumes"
Jul 10 22:04:32.445697 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:32.445671    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:32.466683 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:32.466652    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7184-139850079264608_9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b/test-curl-7184-139850079264608/0.log"
Jul 10 22:04:32.491691 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:32.491657    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7184-139850079264608"]
Jul 10 22:04:32.495403 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:32.495377    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7184-139850079264608"]
Jul 10 22:04:32.614825 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:32.614794    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gql9b\" (UniqueName: \"kubernetes.io/projected/9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b-kube-api-access-gql9b\") pod \"9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b\" (UID: \"9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b\") "
Jul 10 22:04:32.616847 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:32.616817    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b-kube-api-access-gql9b" (OuterVolumeSpecName: "kube-api-access-gql9b") pod "9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b" (UID: "9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b"). InnerVolumeSpecName "kube-api-access-gql9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:04:32.716327 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:32.716267    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gql9b\" (UniqueName: \"kubernetes.io/projected/9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b-kube-api-access-gql9b\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:33.183533 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:33.183495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:04:33.294640 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:33.294599    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:04:33.299385 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:33.299363    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:33.299540 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:33.299371    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52d2e0ff7065f87dd5f474b7903a0f5b29fe46cde7216d95c026934e74eb9aed"
Jul 10 22:04:33.308916 ip-10-0-141-131 kubenswrapper[2575]: E0710 22:04:33.308890    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7184-139850079264608\" is forbidden: User \"system:node:ip-10-0-141-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-131.ec2.internal' and this object" podUID="9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b" pod="openshift-ingress/test-curl-7184-139850079264608"
Jul 10 22:04:33.523888 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:33.523805    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b" path="/var/lib/kubelet/pods/9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b/volumes"
Jul 10 22:04:43.120376 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.120266    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"]
Jul 10 22:04:43.120860 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.120540    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff" podUID="d4443437-06eb-4543-8075-92c664769dfd" containerName="maas-api" containerID="cri-o://e9107d98805000c3e1365a8a02739ca21f14e06b271ef8b96ee283ec31e893b1" gracePeriod=30
Jul 10 22:04:43.150854 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.150818    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:04:43.355973 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.355938    2575 generic.go:356] "Generic (PLEG): container finished" podID="d4443437-06eb-4543-8075-92c664769dfd" containerID="e9107d98805000c3e1365a8a02739ca21f14e06b271ef8b96ee283ec31e893b1" exitCode=0
Jul 10 22:04:43.356115 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.356006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff" event={"ID":"d4443437-06eb-4543-8075-92c664769dfd","Type":"ContainerDied","Data":"e9107d98805000c3e1365a8a02739ca21f14e06b271ef8b96ee283ec31e893b1"}
Jul 10 22:04:43.374937 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.374880    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 22:04:43.410940 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.410904    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4443437-06eb-4543-8075-92c664769dfd-openshift-service-ca\") pod \"d4443437-06eb-4543-8075-92c664769dfd\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") "
Jul 10 22:04:43.411098 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.410962    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7pb6\" (UniqueName: \"kubernetes.io/projected/d4443437-06eb-4543-8075-92c664769dfd-kube-api-access-k7pb6\") pod \"d4443437-06eb-4543-8075-92c664769dfd\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") "
Jul 10 22:04:43.411098 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.410983    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4443437-06eb-4543-8075-92c664769dfd-maas-api-tls\") pod \"d4443437-06eb-4543-8075-92c664769dfd\" (UID: \"d4443437-06eb-4543-8075-92c664769dfd\") "
Jul 10 22:04:43.411344 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.411313    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4443437-06eb-4543-8075-92c664769dfd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d4443437-06eb-4543-8075-92c664769dfd" (UID: "d4443437-06eb-4543-8075-92c664769dfd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 22:04:43.413201 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.413165    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4443437-06eb-4543-8075-92c664769dfd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d4443437-06eb-4543-8075-92c664769dfd" (UID: "d4443437-06eb-4543-8075-92c664769dfd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:04:43.413201 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.413186    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4443437-06eb-4543-8075-92c664769dfd-kube-api-access-k7pb6" (OuterVolumeSpecName: "kube-api-access-k7pb6") pod "d4443437-06eb-4543-8075-92c664769dfd" (UID: "d4443437-06eb-4543-8075-92c664769dfd"). InnerVolumeSpecName "kube-api-access-k7pb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:04:43.511652 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.511615    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4443437-06eb-4543-8075-92c664769dfd-openshift-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:43.511652 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.511643    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7pb6\" (UniqueName: \"kubernetes.io/projected/d4443437-06eb-4543-8075-92c664769dfd-kube-api-access-k7pb6\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:43.511652 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:43.511654    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4443437-06eb-4543-8075-92c664769dfd-maas-api-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:04:44.362654 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:44.362625    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"
Jul 10 22:04:44.363149 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:44.362650    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff" event={"ID":"d4443437-06eb-4543-8075-92c664769dfd","Type":"ContainerDied","Data":"d25478e60b351b86dbddf21a4079ea4def1e002d5452755a2213a1e0118c4669"}
Jul 10 22:04:44.363149 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:44.362716    2575 scope.go:117] "RemoveContainer" containerID="e9107d98805000c3e1365a8a02739ca21f14e06b271ef8b96ee283ec31e893b1"
Jul 10 22:04:44.380909 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:44.380879    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"]
Jul 10 22:04:44.383164 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:44.383143    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-22d37c-66f99647c5-7zmff"]
Jul 10 22:04:45.523055 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:45.523024    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4443437-06eb-4543-8075-92c664769dfd" path="/var/lib/kubelet/pods/d4443437-06eb-4543-8075-92c664769dfd/volumes"
Jul 10 22:04:46.593756 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:46.593718    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:04:47.784637 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:47.784602    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:04:49.824417 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:49.824373    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:04:53.918072 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:53.918031    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:04:54.022070 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:54.022040    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:04:58.499309 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:58.499257    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:04:58.742697 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:58.742664    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:04:59.505552 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:59.505519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:04:59.609078 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:04:59.609046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:05:09.307936 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.307900    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"]
Jul 10 22:05:09.308453 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.308153    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r" podUID="5b0fb19e-4509-4f95-8ed6-1954331df960" containerName="maas-api" containerID="cri-o://91b1cbc03b8bb4866bdcb6d7b91131a289973d98f03c904650b76fcbe603589b" gracePeriod=30
Jul 10 22:05:09.337964 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.337923    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:05:09.510194 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.510161    2575 generic.go:356] "Generic (PLEG): container finished" podID="5b0fb19e-4509-4f95-8ed6-1954331df960" containerID="91b1cbc03b8bb4866bdcb6d7b91131a289973d98f03c904650b76fcbe603589b" exitCode=0
Jul 10 22:05:09.510391 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.510244    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r" event={"ID":"5b0fb19e-4509-4f95-8ed6-1954331df960","Type":"ContainerDied","Data":"91b1cbc03b8bb4866bdcb6d7b91131a289973d98f03c904650b76fcbe603589b"}
Jul 10 22:05:09.568126 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.568061    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 22:05:09.639006 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.638973    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swzkb\" (UniqueName: \"kubernetes.io/projected/5b0fb19e-4509-4f95-8ed6-1954331df960-kube-api-access-swzkb\") pod \"5b0fb19e-4509-4f95-8ed6-1954331df960\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") "
Jul 10 22:05:09.639188 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.639018    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b0fb19e-4509-4f95-8ed6-1954331df960-maas-api-tls\") pod \"5b0fb19e-4509-4f95-8ed6-1954331df960\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") "
Jul 10 22:05:09.639188 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.639042    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b0fb19e-4509-4f95-8ed6-1954331df960-openshift-service-ca\") pod \"5b0fb19e-4509-4f95-8ed6-1954331df960\" (UID: \"5b0fb19e-4509-4f95-8ed6-1954331df960\") "
Jul 10 22:05:09.639457 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.639437    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b0fb19e-4509-4f95-8ed6-1954331df960-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b0fb19e-4509-4f95-8ed6-1954331df960" (UID: "5b0fb19e-4509-4f95-8ed6-1954331df960"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 22:05:09.641312 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.641283    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b0fb19e-4509-4f95-8ed6-1954331df960-kube-api-access-swzkb" (OuterVolumeSpecName: "kube-api-access-swzkb") pod "5b0fb19e-4509-4f95-8ed6-1954331df960" (UID: "5b0fb19e-4509-4f95-8ed6-1954331df960"). InnerVolumeSpecName "kube-api-access-swzkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:05:09.641419 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.641321    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b0fb19e-4509-4f95-8ed6-1954331df960-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b0fb19e-4509-4f95-8ed6-1954331df960" (UID: "5b0fb19e-4509-4f95-8ed6-1954331df960"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:05:09.740511 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.740469    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b0fb19e-4509-4f95-8ed6-1954331df960-maas-api-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:05:09.740511 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.740502    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b0fb19e-4509-4f95-8ed6-1954331df960-openshift-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:05:09.740511 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:09.740512    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swzkb\" (UniqueName: \"kubernetes.io/projected/5b0fb19e-4509-4f95-8ed6-1954331df960-kube-api-access-swzkb\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:05:10.517473 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:10.517439    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"
Jul 10 22:05:10.517911 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:10.517466    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r" event={"ID":"5b0fb19e-4509-4f95-8ed6-1954331df960","Type":"ContainerDied","Data":"bd376e6e52cc13067621b99d0f7a5946e5789f56032fe42472700cc9d794fa2b"}
Jul 10 22:05:10.517911 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:10.517526    2575 scope.go:117] "RemoveContainer" containerID="91b1cbc03b8bb4866bdcb6d7b91131a289973d98f03c904650b76fcbe603589b"
Jul 10 22:05:10.541222 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:10.541193    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"]
Jul 10 22:05:10.547088 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:10.547061    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f937a7-7f6c46c556-gz74r"]
Jul 10 22:05:11.524119 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:11.524084    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b0fb19e-4509-4f95-8ed6-1954331df960" path="/var/lib/kubelet/pods/5b0fb19e-4509-4f95-8ed6-1954331df960/volumes"
Jul 10 22:05:12.499607 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:12.499571    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jzc59"]
Jul 10 22:05:13.951977 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:13.951940    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:05:19.916099 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:19.916059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:05:20.016920 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:20.016883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:05:24.627648 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:24.627609    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"]
Jul 10 22:05:24.628063 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:24.627877    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h" podUID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerName="istio-proxy" containerID="cri-o://807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99" gracePeriod=30
Jul 10 22:05:24.653944 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:24.653898    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:05:24.925752 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:24.925637    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:05:29.882695 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:29.882667    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 22:05:30.021043 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.020939    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-podinfo\") pod \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") "
Jul 10 22:05:30.021043 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.020991    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-token\") pod \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") "
Jul 10 22:05:30.021043 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.021030    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-credential-socket\") pod \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") "
Jul 10 22:05:30.021043 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.021047    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-envoy\") pod \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") "
Jul 10 22:05:30.021406 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.021095    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-workload-socket\") pod \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") "
Jul 10 22:05:30.021406 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.021135    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm6vv\" (UniqueName: \"kubernetes.io/projected/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-kube-api-access-mm6vv\") pod \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") "
Jul 10 22:05:30.021406 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.021170    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-data\") pod \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") "
Jul 10 22:05:30.021406 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.021198    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istiod-ca-cert\") pod \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") "
Jul 10 22:05:30.021406 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.021234    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-workload-certs\") pod \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\" (UID: \"b72d7d00-4660-4bfb-8bd8-90b273cc70d0\") "
Jul 10 22:05:30.021673 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.021431    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b72d7d00-4660-4bfb-8bd8-90b273cc70d0" (UID: "b72d7d00-4660-4bfb-8bd8-90b273cc70d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:05:30.021673 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.021514    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b72d7d00-4660-4bfb-8bd8-90b273cc70d0" (UID: "b72d7d00-4660-4bfb-8bd8-90b273cc70d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:05:30.021673 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.021533    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-credential-socket\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:05:30.021843 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.021656    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b72d7d00-4660-4bfb-8bd8-90b273cc70d0" (UID: "b72d7d00-4660-4bfb-8bd8-90b273cc70d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:05:30.021900 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.021839    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b72d7d00-4660-4bfb-8bd8-90b273cc70d0" (UID: "b72d7d00-4660-4bfb-8bd8-90b273cc70d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 22:05:30.022357 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.022331    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "b72d7d00-4660-4bfb-8bd8-90b273cc70d0" (UID: "b72d7d00-4660-4bfb-8bd8-90b273cc70d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:05:30.023840 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.023809    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b72d7d00-4660-4bfb-8bd8-90b273cc70d0" (UID: "b72d7d00-4660-4bfb-8bd8-90b273cc70d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:05:30.023940 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.023840    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b72d7d00-4660-4bfb-8bd8-90b273cc70d0" (UID: "b72d7d00-4660-4bfb-8bd8-90b273cc70d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 22:05:30.023940 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.023840    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-kube-api-access-mm6vv" (OuterVolumeSpecName: "kube-api-access-mm6vv") pod "b72d7d00-4660-4bfb-8bd8-90b273cc70d0" (UID: "b72d7d00-4660-4bfb-8bd8-90b273cc70d0"). InnerVolumeSpecName "kube-api-access-mm6vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:05:30.023940 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.023885    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "b72d7d00-4660-4bfb-8bd8-90b273cc70d0" (UID: "b72d7d00-4660-4bfb-8bd8-90b273cc70d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:05:30.122702 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.122658    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-workload-certs\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:05:30.122702 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.122692    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-podinfo\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:05:30.122702 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.122707    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-token\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:05:30.122961 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.122718    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-envoy\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:05:30.122961 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.122730    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-workload-socket\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:05:30.122961 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.122742    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm6vv\" (UniqueName: \"kubernetes.io/projected/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-kube-api-access-mm6vv\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:05:30.122961 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.122754    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istio-data\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:05:30.122961 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.122765    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b72d7d00-4660-4bfb-8bd8-90b273cc70d0-istiod-ca-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\""
Jul 10 22:05:30.237788 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.237755    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w7zkz_16113ca9-4fa3-40df-9eff-1da6482d5c93/manager/0.log"
Jul 10 22:05:30.360693 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.360663    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-97nwr_9fcf9535-e6cf-4af3-9b20-37334aff41c4/manager/0.log"
Jul 10 22:05:30.492815 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.492783    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d675976db-5mt27_fd7ba268-c256-488b-8775-d95abd5ca62b/manager/0.log"
Jul 10 22:05:30.620887 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.620795    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bq4g2_ac2357ad-56e8-4deb-8265-989bfe7912a1/server/0.log"
Jul 10 22:05:30.626076 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.626048    2575 generic.go:356] "Generic (PLEG): container finished" podID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerID="807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99" exitCode=0
Jul 10 22:05:30.626233 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.626098    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"
Jul 10 22:05:30.626233 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.626127    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h" event={"ID":"b72d7d00-4660-4bfb-8bd8-90b273cc70d0","Type":"ContainerDied","Data":"807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99"}
Jul 10 22:05:30.626233 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.626194    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h" event={"ID":"b72d7d00-4660-4bfb-8bd8-90b273cc70d0","Type":"ContainerDied","Data":"7687e720091c7eb58ee0ea5a25ae3a38031775d28319676b307c31b5336e1794"}
Jul 10 22:05:30.626233 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.626223    2575 scope.go:117] "RemoveContainer" containerID="807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99"
Jul 10 22:05:30.635990 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.635971    2575 scope.go:117] "RemoveContainer" containerID="a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f"
Jul 10 22:05:30.644372 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.644353    2575 scope.go:117] "RemoveContainer" containerID="807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99"
Jul 10 22:05:30.644632 ip-10-0-141-131 kubenswrapper[2575]: E0710 22:05:30.644607    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99\": container with ID starting with 807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99 not found: ID does not exist" containerID="807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99"
Jul 10 22:05:30.644707 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.644642    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99"} err="failed to get container status \"807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99\": rpc error: code = NotFound desc = could not find container \"807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99\": container with ID starting with 807373665bbf566ce1d6eb58d6b78d893e01962206a189d9979d3ba5cc1d9f99 not found: ID does not exist"
Jul 10 22:05:30.644707 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.644668    2575 scope.go:117] "RemoveContainer" containerID="a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f"
Jul 10 22:05:30.644912 ip-10-0-141-131 kubenswrapper[2575]: E0710 22:05:30.644895    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f\": container with ID starting with a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f not found: ID does not exist" containerID="a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f"
Jul 10 22:05:30.644956 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.644918    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f"} err="failed to get container status \"a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f\": rpc error: code = NotFound desc = could not find container \"a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f\": container with ID starting with a12a07114267f330342ac5b5c0c4ab1835a1c9d0a6b22d3c55ffd4313ab5451f not found: ID does not exist"
Jul 10 22:05:30.648320 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.648300    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"]
Jul 10 22:05:30.654699 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.654678    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-f937a7-openshift-default-769f7f479f-9h44h"]
Jul 10 22:05:30.753139 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.753107    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-k4qks_dcc50043-beb8-4be5-99c4-50f53ca29eba/manager/0.log"
Jul 10 22:05:30.878079 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.878004    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d8977cb58-27p7s_798507c2-89b0-40dd-bbb8-3d46af28c081/copy-manifests/0.log"
Jul 10 22:05:30.896615 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:30.896582    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d8977cb58-27p7s_798507c2-89b0-40dd-bbb8-3d46af28c081/manager/0.log"
Jul 10 22:05:31.517109 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:31.517077    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-9c64f46fb-4fzjw_7bc05283-cb04-419a-9e03-bc44145cde14/maas-api/0.log"
Jul 10 22:05:31.522886 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:31.522859    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" path="/var/lib/kubelet/pods/b72d7d00-4660-4bfb-8bd8-90b273cc70d0/volumes"
Jul 10 22:05:31.853952 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:31.853921    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-22c1dfe4-wd4dc_168ff8d7-e684-42db-a7c7-23fe63449565/revoke-keys/1.log"
Jul 10 22:05:33.849164 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:33.849134    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42_628e9d85-049b-4e3b-be5f-e5fb5c236d29/util/0.log"
Jul 10 22:05:33.859244 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:33.859219    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42_628e9d85-049b-4e3b-be5f-e5fb5c236d29/pull/0.log"
Jul 10 22:05:33.866242 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:33.866221    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42_628e9d85-049b-4e3b-be5f-e5fb5c236d29/extract/0.log"
Jul 10 22:05:33.972911 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:33.972881    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d_d083ccdf-f370-4d97-9e42-5cf26dffe16a/util/0.log"
Jul 10 22:05:33.982515 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:33.982484    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d_d083ccdf-f370-4d97-9e42-5cf26dffe16a/pull/0.log"
Jul 10 22:05:33.989297 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:33.989252    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d_d083ccdf-f370-4d97-9e42-5cf26dffe16a/extract/0.log"
Jul 10 22:05:34.097372 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:34.097341    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr_4dc47687-277c-47d5-a256-2440265ac877/util/0.log"
Jul 10 22:05:34.104330 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:34.104256    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr_4dc47687-277c-47d5-a256-2440265ac877/pull/0.log"
Jul 10 22:05:34.110885 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:34.110866    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr_4dc47687-277c-47d5-a256-2440265ac877/extract/0.log"
Jul 10 22:05:34.224660 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:34.224626    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77_7516491e-b0ef-447a-97d8-a90c9d2eacca/extract/0.log"
Jul 10 22:05:34.231961 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:34.231931    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77_7516491e-b0ef-447a-97d8-a90c9d2eacca/util/0.log"
Jul 10 22:05:34.240558 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:34.240532    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77_7516491e-b0ef-447a-97d8-a90c9d2eacca/pull/0.log"
Jul 10 22:05:34.485998 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:34.485916    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tbm6v_1856280b-f2e1-4c32-b1a1-e7290bbc0dba/manager/0.log"
Jul 10 22:05:34.840519 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:34.840492    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7t9wp_89b1aff5-f8bf-471f-a5b4-f9de786467de/registry-server/0.log"
Jul 10 22:05:35.107840 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:35.107754    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jzc59_12b586e1-b503-4c5d-9eed-572197941bc3/limitador/0.log"
Jul 10 22:05:35.240026 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:35.239997    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wd75k_e550e4f3-3bc4-4402-a9f4-bb38f7aa4f52/manager/0.log"
Jul 10 22:05:35.927725 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:35.927694    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c7cf6c8b8-lrmch_d833e77e-d8e1-48f6-b76c-9afcb13af7c4/kube-auth-proxy/0.log"
Jul 10 22:05:36.047679 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:36.047634    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wfrg7_196f85b0-a352-4c0a-8591-5fd20046d8d9/istio-proxy/1.log"
Jul 10 22:05:36.295524 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:36.295439    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-dx4dh_8f26fd12-63b6-478c-b1e5-097e8f37d2f9/payload-processing/0.log"
Jul 10 22:05:37.004073 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:37.004043    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-tsdqc_faf2be32-3c61-47e3-9803-1470b012f701/main/0.log"
Jul 10 22:05:37.349856 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:37.349830    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-vqjpp_ab584d2f-02d3-43e2-859a-daf7fe55449c/main/0.log"
Jul 10 22:05:41.964651 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.964612    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jk69p/must-gather-k9njd"]
Jul 10 22:05:41.965049 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.964949    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b" containerName="test-curl-7184-139850079264608"
Jul 10 22:05:41.965049 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.964959    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b" containerName="test-curl-7184-139850079264608"
Jul 10 22:05:41.965049 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.964974    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerName="istio-proxy"
Jul 10 22:05:41.965049 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.964980    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerName="istio-proxy"
Jul 10 22:05:41.965049 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.964992    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4443437-06eb-4543-8075-92c664769dfd" containerName="maas-api"
Jul 10 22:05:41.965049 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.964997    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4443437-06eb-4543-8075-92c664769dfd" containerName="maas-api"
Jul 10 22:05:41.965049 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.965007    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b0fb19e-4509-4f95-8ed6-1954331df960" containerName="maas-api"
Jul 10 22:05:41.965049 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.965012    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b0fb19e-4509-4f95-8ed6-1954331df960" containerName="maas-api"
Jul 10 22:05:41.965378 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.965066    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b0fb19e-4509-4f95-8ed6-1954331df960" containerName="maas-api"
Jul 10 22:05:41.965378 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.965074    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerName="istio-proxy"
Jul 10 22:05:41.965378 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.965079    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ef1dd6f-3667-42ed-b1d2-58d4bb8bbd6b" containerName="test-curl-7184-139850079264608"
Jul 10 22:05:41.965378 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.965086    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4443437-06eb-4543-8075-92c664769dfd" containerName="maas-api"
Jul 10 22:05:41.965378 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.965093    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerName="istio-proxy"
Jul 10 22:05:41.965378 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.965155    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerName="istio-proxy"
Jul 10 22:05:41.965378 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.965160    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72d7d00-4660-4bfb-8bd8-90b273cc70d0" containerName="istio-proxy"
Jul 10 22:05:41.969713 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.969696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jk69p/must-gather-k9njd"
Jul 10 22:05:41.973337 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.973312    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jk69p\"/\"kube-root-ca.crt\""
Jul 10 22:05:41.973483 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.973312    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jk69p\"/\"openshift-service-ca.crt\""
Jul 10 22:05:41.973924 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.973908    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jk69p\"/\"default-dockercfg-gpq7z\""
Jul 10 22:05:41.983739 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.983702    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:05:41.984850 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:41.984827    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jk69p/must-gather-k9njd"]
Jul 10 22:05:42.013655 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:42.013622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c07d8afb-81d5-4a9f-920b-594813ed8385-must-gather-output\") pod \"must-gather-k9njd\" (UID: \"c07d8afb-81d5-4a9f-920b-594813ed8385\") " pod="openshift-must-gather-jk69p/must-gather-k9njd"
Jul 10 22:05:42.013824 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:42.013697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sgdf\" (UniqueName: \"kubernetes.io/projected/c07d8afb-81d5-4a9f-920b-594813ed8385-kube-api-access-4sgdf\") pod \"must-gather-k9njd\" (UID: \"c07d8afb-81d5-4a9f-920b-594813ed8385\") " pod="openshift-must-gather-jk69p/must-gather-k9njd"
Jul 10 22:05:42.086412 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:42.086378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:05:42.115141 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:42.115093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c07d8afb-81d5-4a9f-920b-594813ed8385-must-gather-output\") pod \"must-gather-k9njd\" (UID: \"c07d8afb-81d5-4a9f-920b-594813ed8385\") " pod="openshift-must-gather-jk69p/must-gather-k9njd"
Jul 10 22:05:42.115351 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:42.115188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sgdf\" (UniqueName: \"kubernetes.io/projected/c07d8afb-81d5-4a9f-920b-594813ed8385-kube-api-access-4sgdf\") pod \"must-gather-k9njd\" (UID: \"c07d8afb-81d5-4a9f-920b-594813ed8385\") " pod="openshift-must-gather-jk69p/must-gather-k9njd"
Jul 10 22:05:42.115529 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:42.115506    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c07d8afb-81d5-4a9f-920b-594813ed8385-must-gather-output\") pod \"must-gather-k9njd\" (UID: \"c07d8afb-81d5-4a9f-920b-594813ed8385\") " pod="openshift-must-gather-jk69p/must-gather-k9njd"
Jul 10 22:05:42.124030 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:42.124006    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sgdf\" (UniqueName: \"kubernetes.io/projected/c07d8afb-81d5-4a9f-920b-594813ed8385-kube-api-access-4sgdf\") pod \"must-gather-k9njd\" (UID: \"c07d8afb-81d5-4a9f-920b-594813ed8385\") " pod="openshift-must-gather-jk69p/must-gather-k9njd"
Jul 10 22:05:42.279765 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:42.279676    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jk69p/must-gather-k9njd"
Jul 10 22:05:42.416396 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:42.416372    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jk69p/must-gather-k9njd"]
Jul 10 22:05:42.418390 ip-10-0-141-131 kubenswrapper[2575]: W0710 22:05:42.418363    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc07d8afb_81d5_4a9f_920b_594813ed8385.slice/crio-9f030a218b9eaa718f17d78d8c00bd5c2f43f4119de762360f7ccda69360e51b WatchSource:0}: Error finding container 9f030a218b9eaa718f17d78d8c00bd5c2f43f4119de762360f7ccda69360e51b: Status 404 returned error can't find the container with id 9f030a218b9eaa718f17d78d8c00bd5c2f43f4119de762360f7ccda69360e51b
Jul 10 22:05:42.696338 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:42.696291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jk69p/must-gather-k9njd" event={"ID":"c07d8afb-81d5-4a9f-920b-594813ed8385","Type":"ContainerStarted","Data":"9f030a218b9eaa718f17d78d8c00bd5c2f43f4119de762360f7ccda69360e51b"}
Jul 10 22:05:44.708788 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:44.708744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jk69p/must-gather-k9njd" event={"ID":"c07d8afb-81d5-4a9f-920b-594813ed8385","Type":"ContainerStarted","Data":"7fd77e3bfd7350f2a73ab0a7412ffd432c28933bf04b0b460356c3c9ea56714a"}
Jul 10 22:05:44.709198 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:44.708801    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jk69p/must-gather-k9njd" event={"ID":"c07d8afb-81d5-4a9f-920b-594813ed8385","Type":"ContainerStarted","Data":"54fe9dfa12a1157abb2321567e5ba3131460f22920c92a783094ed07464caefe"}
Jul 10 22:05:44.735420 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:44.735335    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jk69p/must-gather-k9njd" podStartSLOduration=2.436204315 podStartE2EDuration="3.735314643s" totalImagesPullingTime="1.299110328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:05:44.730637324 +0000 UTC m=+2670.363882578" watchObservedRunningTime="2026-07-10 22:05:44.735314643 +0000 UTC m=+2670.368559898"
Jul 10 22:05:45.377790 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:45.377741    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-279g5_adb715a1-fa72-4b85-b1b1-1a2ddfebac5d/global-pull-secret-syncer/0.log"
Jul 10 22:05:45.535418 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:45.535387    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log"
Jul 10 22:05:45.686109 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:45.686011    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-131.ec2.internal_ee9ba87a95626305bc9fc31aaeb61c99/haproxy/0.log"
Jul 10 22:05:50.090219 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:50.090184    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42_628e9d85-049b-4e3b-be5f-e5fb5c236d29/extract/0.log"
Jul 10 22:05:50.121460 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:50.121424    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42_628e9d85-049b-4e3b-be5f-e5fb5c236d29/util/0.log"
Jul 10 22:05:50.155682 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:50.155641    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hwp42_628e9d85-049b-4e3b-be5f-e5fb5c236d29/pull/0.log"
Jul 10 22:05:50.193870 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:50.193844    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d_d083ccdf-f370-4d97-9e42-5cf26dffe16a/extract/0.log"
Jul 10 22:05:50.231596 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:50.231565    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d_d083ccdf-f370-4d97-9e42-5cf26dffe16a/util/0.log"
Jul 10 22:05:50.284180 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:50.284142    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lh6d_d083ccdf-f370-4d97-9e42-5cf26dffe16a/pull/0.log"
Jul 10 22:05:50.344636 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:50.344552    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr_4dc47687-277c-47d5-a256-2440265ac877/extract/0.log"
Jul 10 22:05:50.366908 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:50.366802    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr_4dc47687-277c-47d5-a256-2440265ac877/util/0.log"
Jul 10 22:05:50.398056 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:50.397973    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bq7vr_4dc47687-277c-47d5-a256-2440265ac877/pull/0.log"
Jul 10 22:05:50.430489 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:50.430463    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77_7516491e-b0ef-447a-97d8-a90c9d2eacca/extract/0.log"
Jul 10 22:05:50.458399 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:50.458374    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77_7516491e-b0ef-447a-97d8-a90c9d2eacca/util/0.log"
Jul 10 22:05:50.484694 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:50.484661    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ksb77_7516491e-b0ef-447a-97d8-a90c9d2eacca/pull/0.log"
Jul 10 22:05:51.081698 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:51.081657    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tbm6v_1856280b-f2e1-4c32-b1a1-e7290bbc0dba/manager/0.log"
Jul 10 22:05:51.212033 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:51.211999    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7t9wp_89b1aff5-f8bf-471f-a5b4-f9de786467de/registry-server/0.log"
Jul 10 22:05:51.412181 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:51.412090    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jzc59_12b586e1-b503-4c5d-9eed-572197941bc3/limitador/0.log"
Jul 10 22:05:51.489217 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:51.489176    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wd75k_e550e4f3-3bc4-4402-a9f4-bb38f7aa4f52/manager/0.log"
Jul 10 22:05:53.647611 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:53.647541    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qksg_53f035c5-d92a-479f-810a-bd34f4ad2adc/node-exporter/0.log"
Jul 10 22:05:53.669431 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:53.669402    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qksg_53f035c5-d92a-479f-810a-bd34f4ad2adc/kube-rbac-proxy/0.log"
Jul 10 22:05:53.692892 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:53.692858    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qksg_53f035c5-d92a-479f-810a-bd34f4ad2adc/init-textfile/0.log"
Jul 10 22:05:55.591923 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.591880    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"]
Jul 10 22:05:55.600124 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.600093    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.606687 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.606657    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"]
Jul 10 22:05:55.651601 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.651544    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-sys\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.651601 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.651615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-462j6\" (UniqueName: \"kubernetes.io/projected/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-kube-api-access-462j6\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.651874 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.651727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-lib-modules\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.651874 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.651788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-podres\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.651874 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.651826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-proc\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.752242 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.752208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-proc\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.752242 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.752248    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-sys\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.752495 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.752301    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-462j6\" (UniqueName: \"kubernetes.io/projected/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-kube-api-access-462j6\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.752495 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.752374    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-proc\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.752495 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.752373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-sys\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.752495 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.752402    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-lib-modules\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.752495 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.752434    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-podres\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.752744 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.752541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-podres\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.752744 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.752551    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-lib-modules\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.761118 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.761076    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-462j6\" (UniqueName: \"kubernetes.io/projected/c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9-kube-api-access-462j6\") pod \"perf-node-gather-daemonset-ms9pl\" (UID: \"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:55.917661 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:55.917571    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:56.077582 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:56.077047    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"]
Jul 10 22:05:56.813324 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:56.813241    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl" event={"ID":"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9","Type":"ContainerStarted","Data":"a2620d385c02458cbb326b76b4d06bab45ef378c25fa51bfefa61a2c655df855"}
Jul 10 22:05:56.813824 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:56.813336    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl" event={"ID":"c9d89f84-05d8-4ae1-88e9-c5fb4eb1cfe9","Type":"ContainerStarted","Data":"d3b138edfa7e3dbccc6c2077a0017463fea9428b3b22b3d42ce604449b6d89a7"}
Jul 10 22:05:56.832208 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:56.832123    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl" podStartSLOduration=1.8321030459999998 podStartE2EDuration="1.832103046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:05:56.829718242 +0000 UTC m=+2682.462963498" watchObservedRunningTime="2026-07-10 22:05:56.832103046 +0000 UTC m=+2682.465348303"
Jul 10 22:05:56.932677 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:56.932646    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-659ccf6b49-7k5nt_86d01283-9161-4544-9a8e-b4c9f222ecc8/console/0.log"
Jul 10 22:05:57.820186 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:57.820150    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:05:58.776924 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:58.776897    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-44hf6_e84fed44-e9d5-4f3e-bc43-d1df60683820/dns/0.log"
Jul 10 22:05:58.803782 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:58.803748    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-44hf6_e84fed44-e9d5-4f3e-bc43-d1df60683820/kube-rbac-proxy/0.log"
Jul 10 22:05:58.992040 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:58.992015    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vsh7h_92b95e58-9d5d-4939-bb6e-c6b0c246546f/dns-node-resolver/0.log"
Jul 10 22:05:59.657505 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:05:59.657466    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4xzxz_7d58d1e4-af64-4f0c-972e-a2e02bc12421/node-ca/0.log"
Jul 10 22:06:00.994317 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:00.994258    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c7cf6c8b8-lrmch_d833e77e-d8e1-48f6-b76c-9afcb13af7c4/kube-auth-proxy/0.log"
Jul 10 22:06:01.026025 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:01.025995    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wfrg7_196f85b0-a352-4c0a-8591-5fd20046d8d9/istio-proxy/0.log"
Jul 10 22:06:01.091917 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:01.091874    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wfrg7_196f85b0-a352-4c0a-8591-5fd20046d8d9/istio-proxy/1.log"
Jul 10 22:06:01.176122 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:01.176078    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-dx4dh_8f26fd12-63b6-478c-b1e5-097e8f37d2f9/payload-processing/0.log"
Jul 10 22:06:02.027395 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:02.027354    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tc6m7_4059fb8a-cf89-4590-93c4-4d817e332b86/serve-healthcheck-canary/0.log"
Jul 10 22:06:02.598853 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:02.598821    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k6wlt_83b4c122-9bc3-4ff3-860b-4e94b8dda99a/kube-rbac-proxy/0.log"
Jul 10 22:06:02.629871 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:02.629838    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k6wlt_83b4c122-9bc3-4ff3-860b-4e94b8dda99a/exporter/0.log"
Jul 10 22:06:02.656998 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:02.656970    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k6wlt_83b4c122-9bc3-4ff3-860b-4e94b8dda99a/extractor/0.log"
Jul 10 22:06:03.838043 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:03.838016    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-ms9pl"
Jul 10 22:06:04.946540 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:04.946503    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w7zkz_16113ca9-4fa3-40df-9eff-1da6482d5c93/manager/0.log"
Jul 10 22:06:05.214423 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:05.214262    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-97nwr_9fcf9535-e6cf-4af3-9b20-37334aff41c4/manager/0.log"
Jul 10 22:06:05.381635 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:05.381593    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d675976db-5mt27_fd7ba268-c256-488b-8775-d95abd5ca62b/manager/0.log"
Jul 10 22:06:05.406337 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:05.406310    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bq4g2_ac2357ad-56e8-4deb-8265-989bfe7912a1/server/0.log"
Jul 10 22:06:05.531825 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:05.531739    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-k4qks_dcc50043-beb8-4be5-99c4-50f53ca29eba/manager/0.log"
Jul 10 22:06:05.643590 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:05.643512    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d8977cb58-27p7s_798507c2-89b0-40dd-bbb8-3d46af28c081/manager/0.log"
Jul 10 22:06:05.665241 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:05.665181    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d8977cb58-27p7s_798507c2-89b0-40dd-bbb8-3d46af28c081/copy-manifests/0.log"
Jul 10 22:06:05.986573 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:05.986542    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c7cf6c8b8-lrmch_d833e77e-d8e1-48f6-b76c-9afcb13af7c4/kube-auth-proxy/0.log"
Jul 10 22:06:06.011493 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:06.011461    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wfrg7_196f85b0-a352-4c0a-8591-5fd20046d8d9/istio-proxy/0.log"
Jul 10 22:06:06.066365 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:06.066331    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wfrg7_196f85b0-a352-4c0a-8591-5fd20046d8d9/istio-proxy/1.log"
Jul 10 22:06:06.135751 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:06.135671    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-dx4dh_8f26fd12-63b6-478c-b1e5-097e8f37d2f9/payload-processing/0.log"
Jul 10 22:06:07.281011 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:07.280983    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-z49xb_56c57172-8f41-43cd-bbb3-431807688de4/openshift-lws-operator/0.log"
Jul 10 22:06:07.736328 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:07.736298    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c7cf6c8b8-lrmch_d833e77e-d8e1-48f6-b76c-9afcb13af7c4/kube-auth-proxy/0.log"
Jul 10 22:06:07.759623 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:07.759587    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wfrg7_196f85b0-a352-4c0a-8591-5fd20046d8d9/istio-proxy/0.log"
Jul 10 22:06:07.814358 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:07.814324    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wfrg7_196f85b0-a352-4c0a-8591-5fd20046d8d9/istio-proxy/1.log"
Jul 10 22:06:07.878228 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:07.878187    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-dx4dh_8f26fd12-63b6-478c-b1e5-097e8f37d2f9/payload-processing/0.log"
Jul 10 22:06:13.274241 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:13.274200    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024
Jul 10 22:06:13.340476 ip-10-0-141-131 kubenswrapper[2575]: I0710 22:06:13.340441    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mn7bk_c397e828-d1fc-45f4-bd7e-23848f0e5ab6/konnectivity-agent/0.log" limit=1024