Jul 24 18:40:10.356518 ip-10-0-141-149 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 18:40:10.745080 ip-10-0-141-149 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 18:40:10.745080 ip-10-0-141-149 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 18:40:10.745080 ip-10-0-141-149 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 18:40:10.745080 ip-10-0-141-149 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 18:40:10.745080 ip-10-0-141-149 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 18:40:10.746004 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.745914    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 18:40:10.751136 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751108    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:40:10.751136 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751130    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:40:10.751136 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751135    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:40:10.751136 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751139    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:40:10.751136 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751158    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:40:10.751136 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751162    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:40:10.751136 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751166    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:40:10.751136 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751170    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:40:10.751136 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751174    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:40:10.751136 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751178    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751183    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751187    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751190    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751194    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751198    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751202    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751206    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751210    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751214    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751217    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751223    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751230    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751235    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751239    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751243    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751247    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751250    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751254    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:40:10.751674 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751258    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751264    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751268    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751273    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751278    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751282    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751286    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751290    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751294    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751297    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751301    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751305    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751309    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751313    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751317    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751324    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751329    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751333    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751338    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751342    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:40:10.752458 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751346    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751350    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751355    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751359    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751363    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751368    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751372    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751377    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751381    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751385    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751391    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751395    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751399    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751404    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751408    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751412    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751416    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751420    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751427    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:40:10.753339 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751431    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751435    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751439    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751444    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751447    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751452    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751456    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751460    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751465    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751470    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751475    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751479    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751483    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751487    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751492    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751496    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751503    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751507    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751511    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751515    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:40:10.754125 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751521    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751527    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751531    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751535    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751539    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751544    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751548    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751552    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751556    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751561    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751565    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.751569    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752797    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752807    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752812    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752816    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752820    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752824    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752830    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:40:10.754985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752835    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752840    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752845    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752849    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752853    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752857    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752862    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752869    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752875    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752880    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752886    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752891    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752895    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752899    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752903    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752908    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752912    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752916    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752920    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752925    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:40:10.755807 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752929    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752933    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752937    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752941    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752945    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752951    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752955    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752959    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752963    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752967    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752971    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752975    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752980    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752986    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752991    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.752995    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753000    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753004    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753008    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:40:10.756417 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753012    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753016    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753020    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753025    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753030    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753034    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753039    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753043    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753048    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753052    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753056    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753062    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753068    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753073    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753078    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753083    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753087    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753091    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753096    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753100    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:40:10.757043 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753104    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753109    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753113    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753118    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753122    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753127    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753131    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753164    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753172    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753177    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753181    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753185    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753190    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753194    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753199    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753203    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753207    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753213    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753217    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:40:10.757695 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753221    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753226    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753230    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753234    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753239    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753243    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753247    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753251    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753255    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753260    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753264    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753268    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753272    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753277    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753921    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753930    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753935    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753940    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753945    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753950    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:40:10.758285 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753954    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753958    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753962    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753967    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753971    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753976    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753980    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753985    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753989    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.753993    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754002    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754007    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754012    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754017    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754021    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754025    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754030    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754034    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754038    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754042    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:40:10.758762 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754046    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754051    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754055    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754059    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754064    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754068    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754072    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754076    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754081    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754084    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754089    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754093    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754097    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754102    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754106    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754110    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754114    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754119    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754123    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754127    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:40:10.759377 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754131    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754135    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754154    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754160    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754165    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754169    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754177    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754184    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754189    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754194    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754199    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754204    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754209    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754213    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754217    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754221    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754225    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754229    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754233    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754237    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:40:10.759884 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754241    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754246    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754254    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754259    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754265    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754270    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754274    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754279    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754283    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754287    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754291    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754296    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754300    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754304    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754308    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754312    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754318    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754322    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754330    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:40:10.760398 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754334    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754338    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754342    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754347    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754351    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754355    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754359    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754366    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754371    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754376    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754381    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754386    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754390    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.754394    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754496    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754509    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754520    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754526    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754533    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754538    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754544    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 18:40:10.760889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754551    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754557    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754562    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754567    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754573    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754578    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754583    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754587    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754593    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754599    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754605    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754612    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754617    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754622    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754627    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754632    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754639    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754644    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754649    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754654    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754659    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754664    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754668    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754673    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 18:40:10.761426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754678    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754685    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754692    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754696    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754701    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754706    2557 flags.go:64] FLAG: --enable-server="true"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754711    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754717    2557 flags.go:64] FLAG: --event-burst="100"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754722    2557 flags.go:64] FLAG: --event-qps="50"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754727    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754732    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754737    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754743    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754748    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754753    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754758    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754762    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754767    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754773    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754778    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754782    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754787    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754792    2557 flags.go:64] FLAG: --feature-gates=""
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754798    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754803    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 18:40:10.762001 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754809    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754814    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754819    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754823    2557 flags.go:64] FLAG: --help="false"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754828    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-141-149.ec2.internal"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754834    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754838    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754843    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754848    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754856    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754860    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754865    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754869    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754874    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754879    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754885    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754890    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754895    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754899    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754904    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754909    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754913    2557 flags.go:64] FLAG: --lock-file=""
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754918    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754923    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 18:40:10.762748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754927    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754936    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754942    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754947    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754951    2557 flags.go:64] FLAG: --logging-format="text"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754956    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754962    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754966    2557 flags.go:64] FLAG: --manifest-url=""
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754971    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754978    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754982    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754989    2557 flags.go:64] FLAG: --max-pods="110"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754993    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.754998    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755002    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755007    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755011    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755018    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755023    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755035    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755040    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755044    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755051    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 24 18:40:10.763359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755055    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755064    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755068    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755073    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755078    2557 flags.go:64] FLAG: --port="10250"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755083    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755088    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01ff718ab915c8e4a"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755093    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755098    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755103    2557 flags.go:64] FLAG: --register-node="true"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755107    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755114    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755119    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755124    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755129    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755134    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755157    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755163    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755167    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755172    2557 flags.go:64] FLAG: --runonce="false"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755177    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755182    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755187    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755191    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755196    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755201    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 18:40:10.763914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755205    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755213    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755218    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755222    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755227    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755233    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755238    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755243    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755247    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755256    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755261    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755266    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755273    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755278    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755283    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755287    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755292    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755297    2557 flags.go:64] FLAG: --v="2"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755304    2557 flags.go:64] FLAG: --version="false"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755312    2557 flags.go:64] FLAG: --vmodule=""
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755318    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.755323    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755505    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755513    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:40:10.764573 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755517    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755522    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755527    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755531    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755536    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755540    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755544    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755548    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755553    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755558    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755564    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755569    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755573    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755579    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755583    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755588    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755592    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755596    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755600    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755604    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:40:10.765158 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755609    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755613    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755617    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755624    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755629    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755634    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755639    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755644    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755654    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755661    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755666    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755670    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755675    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755680    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755684    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755689    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755694    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755698    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755702    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:40:10.765669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755707    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755711    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755717    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755721    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755725    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755729    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755736    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755740    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755745    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755749    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755753    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755757    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755762    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755766    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755769    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755774    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755778    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755782    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755786    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755790    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:40:10.766178 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755794    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755798    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755812    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755816    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755820    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755825    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755829    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755833    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755837    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755842    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755845    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755850    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755854    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755858    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755864    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755868    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755872    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755876    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755881    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755886    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:40:10.766666 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755890    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755894    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755899    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755903    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755907    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755911    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755915    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755919    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755926    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755931    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755936    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755941    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755946    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755952    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755957    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755964    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755968    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:40:10.767155 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.755973    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.756560    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.763761    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.763779    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.764481    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.764488    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764550    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764555    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764560    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764564    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764567    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764570    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764574    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764578    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:40:10.767582 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764581    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764584    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764587    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764589    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764592    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764595    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764599    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764602    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764605    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764608    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764611    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764614    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764617    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764620    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764623    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764625    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764629    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764632    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764634    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764637    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:40:10.767928 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764640    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764643    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764646    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764649    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764652    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764654    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764657    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764659    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764662    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764665    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764667    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764669    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764672    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764675    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764678    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764680    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764683    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764685    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764688    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764691    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:40:10.768435 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764693    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764696    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764698    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764701    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764703    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764706    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764708    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764711    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764714    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764716    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764719    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764722    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764724    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764728    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764730    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764733    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764736    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764738    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764741    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764743    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:40:10.768907 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764746    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764749    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764751    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764754    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764757    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764759    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764761    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764764    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764766    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764769    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764771    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764774    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764776    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764779    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764782    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764784    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764786    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764789    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764791    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:40:10.769454 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764794    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764798    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764801    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764804    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764807    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764809    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764813    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764815    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764818    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764820    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764823    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764825    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.764830    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764938    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:40:10.769904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764943    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764946    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764948    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764951    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764954    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764957    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764960    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764963    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764966    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764968    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764971    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764974    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764976    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764979    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764981    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764983    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764986    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764989    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764992    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764994    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:40:10.770276 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764996    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.764999    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765002    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765004    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765007    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765009    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765013    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765017    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765020    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765023    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765026    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765029    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765031    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765034    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765037    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765040    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765043    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765046    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765048    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:40:10.770749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765051    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765053    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765056    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765059    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765061    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765064    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765066    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765069    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765071    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765074    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765077    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765079    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765082    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765084    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765087    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765089    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765096    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765098    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765101    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765104    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:40:10.771211 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765106    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765109    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765112    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765114    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765117    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765119    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765122    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765124    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765127    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765129    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765132    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765134    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765137    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765152    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765156    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765159    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765161    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765164    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765167    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765170    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:40:10.771702 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765173    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765176    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765178    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765182    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765186    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765188    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765191    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765194    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765197    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765200    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765203    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765206    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765210    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765212    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765215    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765217    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765220    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765223    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:40:10.772249 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:10.765225    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:40:10.772678 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.765230    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 18:40:10.772678 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.765337    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 18:40:10.772678 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.767601    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 18:40:10.772678 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.769114    2557 server.go:1019] "Starting client certificate rotation"
Jul 24 18:40:10.772678 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.769171    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 18:40:10.772678 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.769206    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 18:40:10.772678 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.771232    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 18:40:10.774758 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.772798    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 18:40:10.783977 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.783959    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 24 18:40:10.787031 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.787016    2557 log.go:25] "Validated CRI v1 image API"
Jul 24 18:40:10.788499 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.788485    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 18:40:10.791294 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.791275    2557 fs.go:135] Filesystem UUIDs: map[4ead1be1-0c0c-4532-9559-38d956e56ecc:/dev/nvme0n1p4 758a3934-e564-4996-87f8-0d8cc1a9bc95:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 24 18:40:10.791340 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.791295    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 18:40:10.797107 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.796997    2557 manager.go:216] Machine: {Timestamp:2026-07-24 18:40:10.795685116 +0000 UTC m=+0.325869717 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098892 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec288132728b1cc253180c7ce3743c11 SystemUUID:ec288132-728b-1cc2-5318-0c7ce3743c11 BootID:e5615a58-1d09-4230-ae14-f2b21a429207 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:19:bb:1b:e6:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:19:bb:1b:e6:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:8f:78:91:93:8c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 18:40:10.797107 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.797104    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 18:40:10.797233 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.797210    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 18:40:10.798737 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.798720    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 18:40:10.800085 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.800062    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 18:40:10.800232 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.800090    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-149.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 18:40:10.800850 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.800839    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 18:40:10.800881 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.800854    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 18:40:10.800881 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.800861    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 18:40:10.801560 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.801548    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 18:40:10.803224 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.803214    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 18:40:10.806938 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.806926    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 18:40:10.807073 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.807058    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 18:40:10.807110 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.807096    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 18:40:10.807138 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.807113    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 18:40:10.807138 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.807131    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 18:40:10.807217 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.807158    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 24 18:40:10.807217 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.807171    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 18:40:10.807542 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.807530    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 18:40:10.807576 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.807551    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 18:40:10.811394 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.811377    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 18:40:10.813260 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.813243    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 18:40:10.813378 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.813281    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 18:40:10.815350 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.815330    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 18:40:10.815429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.815355    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 18:40:10.815429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.815362    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 18:40:10.815429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.815369    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 18:40:10.815429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.815379    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 18:40:10.815429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.815391    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 18:40:10.815429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.815399    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 18:40:10.815429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.815405    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 18:40:10.815429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.815413    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 18:40:10.815429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.815419    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 18:40:10.815429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.815429    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 18:40:10.815429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.815435    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 18:40:10.816442 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.816421    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 18:40:10.816442 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.816441    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 18:40:10.820523 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.820501    2557 server.go:1268] "Started kubelet"
Jul 24 18:40:10.820623 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.820541    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 18:40:10.820677 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.820539    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 18:40:10.820735 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.820682    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 18:40:10.821415 ip-10-0-141-149 systemd[1]: Started Kubernetes Kubelet.
Jul 24 18:40:10.821694 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.821675    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-149.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 18:40:10.821770 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:10.821747    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 18:40:10.821867 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:10.821844    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 18:40:10.823588 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.823574    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 18:40:10.823840 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.823824    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 18:40:10.828617 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.828597    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l9278"
Jul 24 18:40:10.829446 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:10.829428    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 18:40:10.829960 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:10.829028    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-149.ec2.internal.18c54dd675ff09f3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-149.ec2.internal,UID:ip-10-0-141-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-149.ec2.internal,},FirstTimestamp:2026-07-24 18:40:10.820258291 +0000 UTC m=+0.350442894,LastTimestamp:2026-07-24 18:40:10.820258291 +0000 UTC m=+0.350442894,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-149.ec2.internal,}"
Jul 24 18:40:10.832706 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.832692    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 18:40:10.832786 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.832704    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 18:40:10.832839 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:10.832817    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-149.ec2.internal\" not found"
Jul 24 18:40:10.834207 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.833382    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 18:40:10.834207 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.833397    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 18:40:10.834207 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.833410    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 18:40:10.834207 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.833517    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 18:40:10.834207 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.833526    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 18:40:10.834207 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.834058    2557 factory.go:55] Registering systemd factory
Jul 24 18:40:10.834207 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.834073    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 24 18:40:10.834538 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.834523    2557 factory.go:153] Registering CRI-O factory
Jul 24 18:40:10.834538 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.834538    2557 factory.go:223] Registration of the crio container factory successfully
Jul 24 18:40:10.834626 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.834595    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 18:40:10.834626 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.834622    2557 factory.go:103] Registering Raw factory
Jul 24 18:40:10.834707 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.834638    2557 manager.go:1196] Started watching for new ooms in manager
Jul 24 18:40:10.835343 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.834944    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l9278"
Jul 24 18:40:10.835343 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:10.835052    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 18:40:10.835343 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.835064    2557 manager.go:349] Starting recovery of all containers
Jul 24 18:40:10.835604 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:10.835530    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 18:40:10.847356 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.847329    2557 manager.go:354] Recovery completed
Jul 24 18:40:10.848742 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:10.848715    2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 24 18:40:10.851827 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.851811    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:10.853941 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.853925    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:10.854020 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.853956    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:10.854020 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.853970    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:10.854664 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.854647    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 18:40:10.854664 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.854660    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 18:40:10.854799 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.854679    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 18:40:10.854799 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.854697    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:10.855423 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.855407    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:10.855514 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.855438    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:10.855514 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.855449    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:10.855907 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.855891    2557 policy_none.go:49] "None policy: Start"
Jul 24 18:40:10.855970 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.855913    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 18:40:10.855970 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.855927    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 18:40:10.857233 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.857219    2557 policy_none.go:47] "Start"
Jul 24 18:40:10.889831 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.889812    2557 manager.go:337] "Starting Device Plugin manager"
Jul 24 18:40:10.889953 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:10.889847    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 18:40:10.889953 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.889857    2557 server.go:87] "Starting device plugin registration server"
Jul 24 18:40:10.890211 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.890199    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 18:40:10.890250 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.890215    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 18:40:10.890371 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.890344    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 18:40:10.890483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.890448    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 18:40:10.890483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.890458    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 18:40:10.891008 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:10.890986    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 18:40:10.891114 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:10.891038    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-149.ec2.internal\" not found"
Jul 24 18:40:10.903232 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.903209    2557 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2590 into the system container \"/system.slice\": <nil>"
Jul 24 18:40:10.990676 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.990644    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:10.992444 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.992217    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:10.992559 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.992472    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:10.992559 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.992493    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:10.992559 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:10.992530    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.001854 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.001809    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.001854 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:11.001837    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-149.ec2.internal\": node \"ip-10-0-141-149.ec2.internal\" not found"
Jul 24 18:40:11.008857 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.008829    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 18:40:11.009939 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.009919    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 18:40:11.010024 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.009951    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 18:40:11.010024 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.009968    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 18:40:11.010024 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:11.009997    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 18:40:11.012583 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.012561    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:11.046820 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:11.046803    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-149.ec2.internal\" not found"
Jul 24 18:40:11.111105 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.111069    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-149.ec2.internal"]
Jul 24 18:40:11.111227 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.111171    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:11.112906 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.112890    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:11.112990 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.112917    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:11.112990 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.112937    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:11.114368 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.114355    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:11.114461 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.114445    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.114509 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.114477    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:11.115043 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.115024    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:11.115154 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.115057    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:11.115154 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.115071    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:11.115154 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.115110    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:11.115283 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.115159    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:11.115283 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.115185    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:11.116552 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.116538    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.116606 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.116562    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:11.117206 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.117189    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:11.117278 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.117221    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:11.117278 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.117236    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:11.136081 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.136060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f5029714b837b4df73aa4ba573cdc40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal\" (UID: \"8f5029714b837b4df73aa4ba573cdc40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.136231 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.136091    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f5029714b837b4df73aa4ba573cdc40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal\" (UID: \"8f5029714b837b4df73aa4ba573cdc40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.136231 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.136122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9603afaddd1d6ed200ec863aca53bb00-config\") pod \"kube-apiserver-proxy-ip-10-0-141-149.ec2.internal\" (UID: \"9603afaddd1d6ed200ec863aca53bb00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.147191 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:11.147169    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-149.ec2.internal\" not found"
Jul 24 18:40:11.153942 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:11.153923    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-149.ec2.internal\" not found" node="ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.158711 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:11.158694    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-149.ec2.internal\" not found" node="ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.236508 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.236481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f5029714b837b4df73aa4ba573cdc40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal\" (UID: \"8f5029714b837b4df73aa4ba573cdc40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.236674 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.236525    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f5029714b837b4df73aa4ba573cdc40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal\" (UID: \"8f5029714b837b4df73aa4ba573cdc40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.236674 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.236543    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9603afaddd1d6ed200ec863aca53bb00-config\") pod \"kube-apiserver-proxy-ip-10-0-141-149.ec2.internal\" (UID: \"9603afaddd1d6ed200ec863aca53bb00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.236674 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.236572    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f5029714b837b4df73aa4ba573cdc40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal\" (UID: \"8f5029714b837b4df73aa4ba573cdc40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.236674 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.236596    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f5029714b837b4df73aa4ba573cdc40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal\" (UID: \"8f5029714b837b4df73aa4ba573cdc40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.236674 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.236569    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9603afaddd1d6ed200ec863aca53bb00-config\") pod \"kube-apiserver-proxy-ip-10-0-141-149.ec2.internal\" (UID: \"9603afaddd1d6ed200ec863aca53bb00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.247762 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:11.247735    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-149.ec2.internal\" not found"
Jul 24 18:40:11.348677 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:11.348604    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-149.ec2.internal\" not found"
Jul 24 18:40:11.449100 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:11.449066    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-149.ec2.internal\" not found"
Jul 24 18:40:11.457267 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.457240    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.462880 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:11.462855    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:11.550041 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:11.550006    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-149.ec2.internal\" not found"
Jul 24 18:40:13.255876 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:13.255846    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-149.ec2.internal\" not found"
Jul 24 18:40:13.305682 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.305655    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:13.338919 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.338890    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:13.349064 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.349028    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 18:40:13.350883 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.350868    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal"
Jul 24 18:40:13.361356 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.361324    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 18:40:13.373471 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.373450    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 18:40:13.373630 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.373607    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 18:40:13.373677 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.373607    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 18:40:13.412786 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.412745    2557 apiserver.go:52] "Watching apiserver"
Jul 24 18:40:13.429460 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.429432    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 18:40:13.430448 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.430422    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-92g8s","openshift-multus/multus-additional-cni-plugins-vn4mn","openshift-multus/network-metrics-daemon-slqg5","kube-system/global-pull-secret-syncer-ms8c7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27","openshift-cluster-node-tuning-operator/tuned-w6f57","openshift-network-diagnostics/network-check-target-nqrpk","openshift-network-operator/iptables-alerter-z257x","openshift-ovn-kubernetes/ovnkube-node-cfctq","kube-system/konnectivity-agent-5ggwk","kube-system/kube-apiserver-proxy-ip-10-0-141-149.ec2.internal","openshift-dns/node-resolver-gf7wk","openshift-image-registry/node-ca-54spr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal"]
Jul 24 18:40:13.432089 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.432065    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:13.432180 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:13.432145    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:13.433045 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.433029    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-54spr"
Jul 24 18:40:13.434033 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.434013    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:13.434110 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:13.434082    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:13.435046 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.435026    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:13.435153 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:13.435087    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:13.435333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.435318    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 18:40:13.435421 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.435323    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 18:40:13.435483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.435441    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 18:40:13.435578 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.435553    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wzgcf\""
Jul 24 18:40:13.436310 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.436294    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.437466 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.437446    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.438082 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.438065    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 18:40:13.438256 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.438242    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 18:40:13.438310 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.438275    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6jdzp\""
Jul 24 18:40:13.438536 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.438520    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 18:40:13.438621 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.438521    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 18:40:13.438837 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.438823    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.439552 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.439533    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 18:40:13.439659 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.439633    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 18:40:13.439721 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.439693    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6mb7s\""
Jul 24 18:40:13.440134 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.440098    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.440778 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.440764    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kzx84\""
Jul 24 18:40:13.440976 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.440960    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 18:40:13.441031 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.441017    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 18:40:13.441318 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.441298    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 18:40:13.441439 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.441313    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 18:40:13.441439 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.441306    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 18:40:13.441439 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.441386    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 18:40:13.441727 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.441713    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.442150 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.442136    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 18:40:13.442726 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.442656    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 18:40:13.442726 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.442663    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 18:40:13.442726 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.442706    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6mkv9\""
Jul 24 18:40:13.442896 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.442710    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 18:40:13.442996 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.442918    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5ggwk"
Jul 24 18:40:13.443853 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.443835    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 18:40:13.444060 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.444022    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jlsnt\""
Jul 24 18:40:13.444060 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.444036    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 18:40:13.444256 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.444242    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z257x"
Jul 24 18:40:13.444843 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.444828    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 18:40:13.444919 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.444833    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 18:35:12 +0000 UTC" deadline="2028-04-25 15:06:41.580816814 +0000 UTC"
Jul 24 18:40:13.444919 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.444886    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15380h26m28.135944251s"
Jul 24 18:40:13.445147 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445131    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-sysconfig\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.445198 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445163    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-run-netns\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.445239 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445193    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f406878b-57b2-47b8-87f0-f682f054d494-serviceca\") pod \"node-ca-54spr\" (UID: \"f406878b-57b2-47b8-87f0-f682f054d494\") " pod="openshift-image-registry/node-ca-54spr"
Jul 24 18:40:13.445239 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445217    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-modprobe-d\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.445335 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-kubernetes\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.445335 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445267    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-run\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.445335 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445299    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 18:40:13.445335 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445321    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lmzg\" (UniqueName: \"kubernetes.io/projected/251138c6-eb4c-4212-963c-dc993e074afc-kube-api-access-5lmzg\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:13.445543 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445425    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lnnm4\""
Jul 24 18:40:13.445543 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445433    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-kubelet-config\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:13.445543 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445466    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-dbus\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:13.445543 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445506    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bxhl\" (UniqueName: \"kubernetes.io/projected/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-kube-api-access-2bxhl\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.445686 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445549    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-systemd\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.445686 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445586    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/414eeb11-c8ea-4e69-8329-2b1049e7c893-tmp\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.445686 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445657    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-run-systemd\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.445789 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445703    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-run-ovn\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.445789 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445730    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.445789 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bdfabff3-effc-4bd5-9524-c81c39646750-env-overrides\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.445789 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445705    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gf7wk"
Jul 24 18:40:13.445789 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445763    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-socket-dir\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.446011 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445800    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-host\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.446011 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445824    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-log-socket\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446011 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445849    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-cni-netd\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446011 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445876    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-registration-dir\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.446011 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-sysctl-conf\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.446011 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc77j\" (UniqueName: \"kubernetes.io/projected/414eeb11-c8ea-4e69-8329-2b1049e7c893-kube-api-access-rc77j\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.446011 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445920    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bdfabff3-effc-4bd5-9524-c81c39646750-ovn-node-metrics-cert\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446011 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvcsw\" (UniqueName: \"kubernetes.io/projected/bdfabff3-effc-4bd5-9524-c81c39646750-kube-api-access-dvcsw\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446011 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445963    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tk2g\" (UniqueName: \"kubernetes.io/projected/f406878b-57b2-47b8-87f0-f682f054d494-kube-api-access-4tk2g\") pod \"node-ca-54spr\" (UID: \"f406878b-57b2-47b8-87f0-f682f054d494\") " pod="openshift-image-registry/node-ca-54spr"
Jul 24 18:40:13.446011 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.445998    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:13.446333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446013    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-sysctl-d\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.446333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446041    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-lib-modules\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.446333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446057    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.446333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446090    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f406878b-57b2-47b8-87f0-f682f054d494-host\") pod \"node-ca-54spr\" (UID: \"f406878b-57b2-47b8-87f0-f682f054d494\") " pod="openshift-image-registry/node-ca-54spr"
Jul 24 18:40:13.446333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446106    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-kubelet\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446121    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-device-dir\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.446333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-sys\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.446333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446149    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-systemd-units\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446189    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-slash\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446245    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-var-lib-openvswitch\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-cni-bin\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446339    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bdfabff3-effc-4bd5-9524-c81c39646750-ovnkube-script-lib\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjttd\" (UniqueName: \"kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd\") pod \"network-check-target-nqrpk\" (UID: \"d145a150-338b-4594-a4b0-be93638911aa\") " pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446448    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446453    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-etc-selinux\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446488    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446511    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-var-lib-kubelet\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-tuned\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446589    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-etc-openvswitch\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446605    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t9kcx\""
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446633    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-run-openvswitch\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446677    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-node-log\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446702    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bdfabff3-effc-4bd5-9524-c81c39646750-ovnkube-config\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446727    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:13.446873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.446755    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-sys-fs\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.447741 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.447726    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 18:40:13.447940 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.447925    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 18:40:13.448607 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.448586    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ndjxl\""
Jul 24 18:40:13.453609 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.453591    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 18:40:13.470554 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.470532    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ktbqt"
Jul 24 18:40:13.479434 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.479417    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ktbqt"
Jul 24 18:40:13.539390 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.539362    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 18:40:13.546951 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.546924    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-multus-socket-dir-parent\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.547027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.546969    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9khk\" (UniqueName: \"kubernetes.io/projected/2bde3e8b-ad6d-4511-b005-247c8795a9d2-kube-api-access-l9khk\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.547027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjttd\" (UniqueName: \"kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd\") pod \"network-check-target-nqrpk\" (UID: \"d145a150-338b-4594-a4b0-be93638911aa\") " pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:13.547092 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547027    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-var-lib-kubelet\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.547092 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547051    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-tuned\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.547092 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547079    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-run-openvswitch\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.547179 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547103    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-node-log\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.547179 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547129    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eae39ad6-5c21-4f9a-859f-1c142c64984d-system-cni-dir\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.547179 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547132    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-var-lib-kubelet\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.547179 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547154    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-multus-cni-dir\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.547288 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547176    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-run-netns\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.547288 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547201    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:13.547288 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547225    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-sys-fs\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.547288 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547235    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-node-log\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.547288 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547249    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-run-netns\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.547444 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eae39ad6-5c21-4f9a-859f-1c142c64984d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.547444 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547307    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-run-openvswitch\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.547444 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547309    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-run-netns\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.547444 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-etc-kubernetes\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.547444 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547396    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-sys-fs\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.547444 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547422    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f9fb4e8-7a2d-44ae-a172-437960383a64-tmp-dir\") pod \"node-resolver-gf7wk\" (UID: \"6f9fb4e8-7a2d-44ae-a172-437960383a64\") " pod="openshift-dns/node-resolver-gf7wk"
Jul 24 18:40:13.547444 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:13.547435    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547449    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-modprobe-d\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547452    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547471    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-run\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:13.547501    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret podName:49c8a3c7-ccf6-48e8-9df2-4b2621742cbd nodeName:}" failed. No retries permitted until 2026-07-24 18:40:14.047482445 +0000 UTC m=+1.972435031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret") pod "global-pull-secret-syncer-ms8c7" (UID: "49c8a3c7-ccf6-48e8-9df2-4b2621742cbd") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547519    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-kubelet-config\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547544    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-dbus\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547568    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-modprobe-d\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547579    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-run\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547600    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547633    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-kubelet-config\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5ccm\" (UniqueName: \"kubernetes.io/projected/eae39ad6-5c21-4f9a-859f-1c142c64984d-kube-api-access-n5ccm\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547683    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-dbus\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547707    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bxhl\" (UniqueName: \"kubernetes.io/projected/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-kube-api-access-2bxhl\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547734    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/414eeb11-c8ea-4e69-8329-2b1049e7c893-tmp\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547783    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-cnibin\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.547839 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bde3e8b-ad6d-4511-b005-247c8795a9d2-cni-binary-copy\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547842    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-multus-conf-dir\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547867    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2bde3e8b-ad6d-4511-b005-247c8795a9d2-multus-daemon-config\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547919    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-log-socket\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547946    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-cni-netd\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547992    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-log-socket\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548002    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-cni-netd\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.547992    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eae39ad6-5c21-4f9a-859f-1c142c64984d-os-release\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548029    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-sysctl-conf\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548060    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc77j\" (UniqueName: \"kubernetes.io/projected/414eeb11-c8ea-4e69-8329-2b1049e7c893-kube-api-access-rc77j\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548102    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eae39ad6-5c21-4f9a-859f-1c142c64984d-cni-binary-copy\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548113    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-sysctl-conf\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548138    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91380c7b-338f-4901-85e1-125ddf986c88-iptables-alerter-script\") pod \"iptables-alerter-z257x\" (UID: \"91380c7b-338f-4901-85e1-125ddf986c88\") " pod="openshift-network-operator/iptables-alerter-z257x"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548194    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548220    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-sysctl-d\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548262    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-lib-modules\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.548483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548291    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f406878b-57b2-47b8-87f0-f682f054d494-host\") pod \"node-ca-54spr\" (UID: \"f406878b-57b2-47b8-87f0-f682f054d494\") " pod="openshift-image-registry/node-ca-54spr"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-kubelet\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548342    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f406878b-57b2-47b8-87f0-f682f054d494-host\") pod \"node-ca-54spr\" (UID: \"f406878b-57b2-47b8-87f0-f682f054d494\") " pod="openshift-image-registry/node-ca-54spr"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548349    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-device-dir\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548353    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-sysctl-d\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548273    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548395    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-sys\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548388    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-lib-modules\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548423    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-device-dir\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548456    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-kubelet\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548459    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-sys\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548491    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-slash\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-var-lib-openvswitch\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548539    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-var-lib-kubelet\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548553    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-slash\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548565    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/184fa814-8fa0-4d76-91ce-aa242fb35a0e-konnectivity-ca\") pod \"konnectivity-agent-5ggwk\" (UID: \"184fa814-8fa0-4d76-91ce-aa242fb35a0e\") " pod="kube-system/konnectivity-agent-5ggwk"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548579    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-var-lib-openvswitch\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.549228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548592    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-etc-selinux\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548619    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-etc-openvswitch\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548643    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bdfabff3-effc-4bd5-9524-c81c39646750-ovnkube-config\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548666    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eae39ad6-5c21-4f9a-859f-1c142c64984d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-sysconfig\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548701    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-etc-openvswitch\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548716    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-etc-selinux\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548718    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f406878b-57b2-47b8-87f0-f682f054d494-serviceca\") pod \"node-ca-54spr\" (UID: \"f406878b-57b2-47b8-87f0-f682f054d494\") " pod="openshift-image-registry/node-ca-54spr"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548765    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-sysconfig\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-kubernetes\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548805    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lmzg\" (UniqueName: \"kubernetes.io/projected/251138c6-eb4c-4212-963c-dc993e074afc-kube-api-access-5lmzg\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548828    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-run-ovn\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548862    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bdfabff3-effc-4bd5-9524-c81c39646750-env-overrides\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548888    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bdfabff3-effc-4bd5-9524-c81c39646750-ovn-node-metrics-cert\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548882    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-kubernetes\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548917    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eae39ad6-5c21-4f9a-859f-1c142c64984d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548941    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-run-ovn\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.550027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548952    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-system-cni-dir\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.548988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-systemd\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549010    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-run-systemd\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549033    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-os-release\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549102    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-var-lib-cni-bin\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549130    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-run-multus-certs\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549173    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/184fa814-8fa0-4d76-91ce-aa242fb35a0e-agent-certs\") pod \"konnectivity-agent-5ggwk\" (UID: \"184fa814-8fa0-4d76-91ce-aa242fb35a0e\") " pod="kube-system/konnectivity-agent-5ggwk"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549227    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-socket-dir\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549233    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f406878b-57b2-47b8-87f0-f682f054d494-serviceca\") pod \"node-ca-54spr\" (UID: \"f406878b-57b2-47b8-87f0-f682f054d494\") " pod="openshift-image-registry/node-ca-54spr"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549253    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-host\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-hostroot\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549313    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-registration-dir\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549347    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-var-lib-cni-multus\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549387    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6hbj\" (UniqueName: \"kubernetes.io/projected/6f9fb4e8-7a2d-44ae-a172-437960383a64-kube-api-access-b6hbj\") pod \"node-resolver-gf7wk\" (UID: \"6f9fb4e8-7a2d-44ae-a172-437960383a64\") " pod="openshift-dns/node-resolver-gf7wk"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549406    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bdfabff3-effc-4bd5-9524-c81c39646750-ovnkube-config\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-systemd-units\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549437    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bdfabff3-effc-4bd5-9524-c81c39646750-ovnkube-script-lib\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.550889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549487    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tk2g\" (UniqueName: \"kubernetes.io/projected/f406878b-57b2-47b8-87f0-f682f054d494-kube-api-access-4tk2g\") pod \"node-ca-54spr\" (UID: \"f406878b-57b2-47b8-87f0-f682f054d494\") " pod="openshift-image-registry/node-ca-54spr"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549511    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549530    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-socket-dir\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549534    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91380c7b-338f-4901-85e1-125ddf986c88-host-slash\") pod \"iptables-alerter-z257x\" (UID: \"91380c7b-338f-4901-85e1-125ddf986c88\") " pod="openshift-network-operator/iptables-alerter-z257x"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549546    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bdfabff3-effc-4bd5-9524-c81c39646750-env-overrides\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549572    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-run-k8s-cni-cncf-io\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549580    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-systemd\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f9fb4e8-7a2d-44ae-a172-437960383a64-hosts-file\") pod \"node-resolver-gf7wk\" (UID: \"6f9fb4e8-7a2d-44ae-a172-437960383a64\") " pod="openshift-dns/node-resolver-gf7wk"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549615    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-run-systemd\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549620    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-cni-bin\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-systemd-units\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549663    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/414eeb11-c8ea-4e69-8329-2b1049e7c893-host\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549674    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvcsw\" (UniqueName: \"kubernetes.io/projected/bdfabff3-effc-4bd5-9524-c81c39646750-kube-api-access-dvcsw\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549716    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eae39ad6-5c21-4f9a-859f-1c142c64984d-cnibin\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549725    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-registration-dir\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549749    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ngnk\" (UniqueName: \"kubernetes.io/projected/91380c7b-338f-4901-85e1-125ddf986c88-kube-api-access-7ngnk\") pod \"iptables-alerter-z257x\" (UID: \"91380c7b-338f-4901-85e1-125ddf986c88\") " pod="openshift-network-operator/iptables-alerter-z257x"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549784    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdfabff3-effc-4bd5-9524-c81c39646750-host-cni-bin\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.551616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.549856    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.552157 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.550105    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bdfabff3-effc-4bd5-9524-c81c39646750-ovnkube-script-lib\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.552157 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:13.550125    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:13.552157 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:13.550191    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs podName:251138c6-eb4c-4212-963c-dc993e074afc nodeName:}" failed. No retries permitted until 2026-07-24 18:40:14.050172859 +0000 UTC m=+1.975125432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs") pod "network-metrics-daemon-slqg5" (UID: "251138c6-eb4c-4212-963c-dc993e074afc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:13.552157 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.551276    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/414eeb11-c8ea-4e69-8329-2b1049e7c893-tmp\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.552157 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.551470    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/414eeb11-c8ea-4e69-8329-2b1049e7c893-etc-tuned\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.552157 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.552005    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bdfabff3-effc-4bd5-9524-c81c39646750-ovn-node-metrics-cert\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.555569 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:13.555459    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:13.555569 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:13.555483    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:13.555569 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:13.555497    2557 projected.go:196] Error preparing data for projected volume kube-api-access-rjttd for pod openshift-network-diagnostics/network-check-target-nqrpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:13.555569 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:13.555562    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd podName:d145a150-338b-4594-a4b0-be93638911aa nodeName:}" failed. No retries permitted until 2026-07-24 18:40:14.055543263 +0000 UTC m=+1.980495848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rjttd" (UniqueName: "kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd") pod "network-check-target-nqrpk" (UID: "d145a150-338b-4594-a4b0-be93638911aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:13.558220 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.558195    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bxhl\" (UniqueName: \"kubernetes.io/projected/230149d3-0a9a-4f7b-ab85-97ea950c0e5c-kube-api-access-2bxhl\") pod \"aws-ebs-csi-driver-node-2bt27\" (UID: \"230149d3-0a9a-4f7b-ab85-97ea950c0e5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.558701 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.558677    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lmzg\" (UniqueName: \"kubernetes.io/projected/251138c6-eb4c-4212-963c-dc993e074afc-kube-api-access-5lmzg\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:13.558845 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.558823    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc77j\" (UniqueName: \"kubernetes.io/projected/414eeb11-c8ea-4e69-8329-2b1049e7c893-kube-api-access-rc77j\") pod \"tuned-w6f57\" (UID: \"414eeb11-c8ea-4e69-8329-2b1049e7c893\") " pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.559263 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.559244    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tk2g\" (UniqueName: \"kubernetes.io/projected/f406878b-57b2-47b8-87f0-f682f054d494-kube-api-access-4tk2g\") pod \"node-ca-54spr\" (UID: \"f406878b-57b2-47b8-87f0-f682f054d494\") " pod="openshift-image-registry/node-ca-54spr"
Jul 24 18:40:13.559603 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.559581    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvcsw\" (UniqueName: \"kubernetes.io/projected/bdfabff3-effc-4bd5-9524-c81c39646750-kube-api-access-dvcsw\") pod \"ovnkube-node-cfctq\" (UID: \"bdfabff3-effc-4bd5-9524-c81c39646750\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.599227 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.599201    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:13.630749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:13.630714    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5029714b837b4df73aa4ba573cdc40.slice/crio-fb7ae424adebf94bf36cfe421ffa1cb32e05005a8333f9bfbc464f4316a83ae8 WatchSource:0}: Error finding container fb7ae424adebf94bf36cfe421ffa1cb32e05005a8333f9bfbc464f4316a83ae8: Status 404 returned error can't find the container with id fb7ae424adebf94bf36cfe421ffa1cb32e05005a8333f9bfbc464f4316a83ae8
Jul 24 18:40:13.631270 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:13.631255    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9603afaddd1d6ed200ec863aca53bb00.slice/crio-d6615dc674bdafc79d49d23113c0cee95f1e11e8a24be9f29e184a46126f53c4 WatchSource:0}: Error finding container d6615dc674bdafc79d49d23113c0cee95f1e11e8a24be9f29e184a46126f53c4: Status 404 returned error can't find the container with id d6615dc674bdafc79d49d23113c0cee95f1e11e8a24be9f29e184a46126f53c4
Jul 24 18:40:13.637889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.637871    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 18:40:13.650061 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650035    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eae39ad6-5c21-4f9a-859f-1c142c64984d-cnibin\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.650168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650074    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ngnk\" (UniqueName: \"kubernetes.io/projected/91380c7b-338f-4901-85e1-125ddf986c88-kube-api-access-7ngnk\") pod \"iptables-alerter-z257x\" (UID: \"91380c7b-338f-4901-85e1-125ddf986c88\") " pod="openshift-network-operator/iptables-alerter-z257x"
Jul 24 18:40:13.650168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650102    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-multus-socket-dir-parent\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650141    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eae39ad6-5c21-4f9a-859f-1c142c64984d-cnibin\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.650168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650151    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9khk\" (UniqueName: \"kubernetes.io/projected/2bde3e8b-ad6d-4511-b005-247c8795a9d2-kube-api-access-l9khk\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650408 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650203    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eae39ad6-5c21-4f9a-859f-1c142c64984d-system-cni-dir\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.650408 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650207    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-multus-socket-dir-parent\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650408 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650223    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-multus-cni-dir\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650408 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650238    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-run-netns\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650408 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650275    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eae39ad6-5c21-4f9a-859f-1c142c64984d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.650408 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650295    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eae39ad6-5c21-4f9a-859f-1c142c64984d-system-cni-dir\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.650408 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650292    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-etc-kubernetes\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650408 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650366    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f9fb4e8-7a2d-44ae-a172-437960383a64-tmp-dir\") pod \"node-resolver-gf7wk\" (UID: \"6f9fb4e8-7a2d-44ae-a172-437960383a64\") " pod="openshift-dns/node-resolver-gf7wk"
Jul 24 18:40:13.650408 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650398    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-multus-cni-dir\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650422    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5ccm\" (UniqueName: \"kubernetes.io/projected/eae39ad6-5c21-4f9a-859f-1c142c64984d-kube-api-access-n5ccm\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650427    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-etc-kubernetes\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650436    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-run-netns\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650440    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-cnibin\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650477    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bde3e8b-ad6d-4511-b005-247c8795a9d2-cni-binary-copy\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650500    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-cnibin\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650504    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-multus-conf-dir\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650538    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-multus-conf-dir\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650552    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2bde3e8b-ad6d-4511-b005-247c8795a9d2-multus-daemon-config\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650582    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eae39ad6-5c21-4f9a-859f-1c142c64984d-os-release\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650608    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eae39ad6-5c21-4f9a-859f-1c142c64984d-cni-binary-copy\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650632    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91380c7b-338f-4901-85e1-125ddf986c88-iptables-alerter-script\") pod \"iptables-alerter-z257x\" (UID: \"91380c7b-338f-4901-85e1-125ddf986c88\") " pod="openshift-network-operator/iptables-alerter-z257x"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650675    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-var-lib-kubelet\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650696    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/184fa814-8fa0-4d76-91ce-aa242fb35a0e-konnectivity-ca\") pod \"konnectivity-agent-5ggwk\" (UID: \"184fa814-8fa0-4d76-91ce-aa242fb35a0e\") " pod="kube-system/konnectivity-agent-5ggwk"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650717    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f9fb4e8-7a2d-44ae-a172-437960383a64-tmp-dir\") pod \"node-resolver-gf7wk\" (UID: \"6f9fb4e8-7a2d-44ae-a172-437960383a64\") " pod="openshift-dns/node-resolver-gf7wk"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650720    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eae39ad6-5c21-4f9a-859f-1c142c64984d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.650852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650756    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eae39ad6-5c21-4f9a-859f-1c142c64984d-os-release\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eae39ad6-5c21-4f9a-859f-1c142c64984d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650807    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-system-cni-dir\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650831    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-os-release\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650853    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eae39ad6-5c21-4f9a-859f-1c142c64984d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650891    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-var-lib-cni-bin\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650917    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-os-release\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650938    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-system-cni-dir\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-var-lib-cni-bin\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650970    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-run-multus-certs\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650994    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/184fa814-8fa0-4d76-91ce-aa242fb35a0e-agent-certs\") pod \"konnectivity-agent-5ggwk\" (UID: \"184fa814-8fa0-4d76-91ce-aa242fb35a0e\") " pod="kube-system/konnectivity-agent-5ggwk"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651022    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-hostroot\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651033    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-var-lib-kubelet\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651045    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-var-lib-cni-multus\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651074    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6hbj\" (UniqueName: \"kubernetes.io/projected/6f9fb4e8-7a2d-44ae-a172-437960383a64-kube-api-access-b6hbj\") pod \"node-resolver-gf7wk\" (UID: \"6f9fb4e8-7a2d-44ae-a172-437960383a64\") " pod="openshift-dns/node-resolver-gf7wk"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651102    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91380c7b-338f-4901-85e1-125ddf986c88-host-slash\") pod \"iptables-alerter-z257x\" (UID: \"91380c7b-338f-4901-85e1-125ddf986c88\") " pod="openshift-network-operator/iptables-alerter-z257x"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651120    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bde3e8b-ad6d-4511-b005-247c8795a9d2-cni-binary-copy\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651129    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-run-k8s-cni-cncf-io\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.651695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651152    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f9fb4e8-7a2d-44ae-a172-437960383a64-hosts-file\") pod \"node-resolver-gf7wk\" (UID: \"6f9fb4e8-7a2d-44ae-a172-437960383a64\") " pod="openshift-dns/node-resolver-gf7wk"
Jul 24 18:40:13.652234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651226    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2bde3e8b-ad6d-4511-b005-247c8795a9d2-multus-daemon-config\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.652234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651267    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f9fb4e8-7a2d-44ae-a172-437960383a64-hosts-file\") pod \"node-resolver-gf7wk\" (UID: \"6f9fb4e8-7a2d-44ae-a172-437960383a64\") " pod="openshift-dns/node-resolver-gf7wk"
Jul 24 18:40:13.652234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651278    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-run-multus-certs\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.652234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.650991    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eae39ad6-5c21-4f9a-859f-1c142c64984d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.652234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651314    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-hostroot\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.652234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651323    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eae39ad6-5c21-4f9a-859f-1c142c64984d-cni-binary-copy\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.652234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651355    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91380c7b-338f-4901-85e1-125ddf986c88-host-slash\") pod \"iptables-alerter-z257x\" (UID: \"91380c7b-338f-4901-85e1-125ddf986c88\") " pod="openshift-network-operator/iptables-alerter-z257x"
Jul 24 18:40:13.652234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651406    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91380c7b-338f-4901-85e1-125ddf986c88-iptables-alerter-script\") pod \"iptables-alerter-z257x\" (UID: \"91380c7b-338f-4901-85e1-125ddf986c88\") " pod="openshift-network-operator/iptables-alerter-z257x"
Jul 24 18:40:13.652234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651413    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-var-lib-cni-multus\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.652234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651410    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2bde3e8b-ad6d-4511-b005-247c8795a9d2-host-run-k8s-cni-cncf-io\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.652234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651482    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/184fa814-8fa0-4d76-91ce-aa242fb35a0e-konnectivity-ca\") pod \"konnectivity-agent-5ggwk\" (UID: \"184fa814-8fa0-4d76-91ce-aa242fb35a0e\") " pod="kube-system/konnectivity-agent-5ggwk"
Jul 24 18:40:13.652234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.651579    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eae39ad6-5c21-4f9a-859f-1c142c64984d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.653530 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.653509    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/184fa814-8fa0-4d76-91ce-aa242fb35a0e-agent-certs\") pod \"konnectivity-agent-5ggwk\" (UID: \"184fa814-8fa0-4d76-91ce-aa242fb35a0e\") " pod="kube-system/konnectivity-agent-5ggwk"
Jul 24 18:40:13.661084 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.661058    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9khk\" (UniqueName: \"kubernetes.io/projected/2bde3e8b-ad6d-4511-b005-247c8795a9d2-kube-api-access-l9khk\") pod \"multus-92g8s\" (UID: \"2bde3e8b-ad6d-4511-b005-247c8795a9d2\") " pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.662282 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.662255    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5ccm\" (UniqueName: \"kubernetes.io/projected/eae39ad6-5c21-4f9a-859f-1c142c64984d-kube-api-access-n5ccm\") pod \"multus-additional-cni-plugins-vn4mn\" (UID: \"eae39ad6-5c21-4f9a-859f-1c142c64984d\") " pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.662811 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.662790    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6hbj\" (UniqueName: \"kubernetes.io/projected/6f9fb4e8-7a2d-44ae-a172-437960383a64-kube-api-access-b6hbj\") pod \"node-resolver-gf7wk\" (UID: \"6f9fb4e8-7a2d-44ae-a172-437960383a64\") " pod="openshift-dns/node-resolver-gf7wk"
Jul 24 18:40:13.662884 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.662826    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ngnk\" (UniqueName: \"kubernetes.io/projected/91380c7b-338f-4901-85e1-125ddf986c88-kube-api-access-7ngnk\") pod \"iptables-alerter-z257x\" (UID: \"91380c7b-338f-4901-85e1-125ddf986c88\") " pod="openshift-network-operator/iptables-alerter-z257x"
Jul 24 18:40:13.778220 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.778129    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-54spr"
Jul 24 18:40:13.784934 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.784905    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27"
Jul 24 18:40:13.786542 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:13.786513    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf406878b_57b2_47b8_87f0_f682f054d494.slice/crio-193c8dabc28a911915a0b1187f27c8d0ace7381e6a1137f0a537efc53dd4f7d5 WatchSource:0}: Error finding container 193c8dabc28a911915a0b1187f27c8d0ace7381e6a1137f0a537efc53dd4f7d5: Status 404 returned error can't find the container with id 193c8dabc28a911915a0b1187f27c8d0ace7381e6a1137f0a537efc53dd4f7d5
Jul 24 18:40:13.792030 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:13.792003    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230149d3_0a9a_4f7b_ab85_97ea950c0e5c.slice/crio-c8d0349e250477f78ce8dcd95e1288bff140ff521a2a775641e8e41df2ed1087 WatchSource:0}: Error finding container c8d0349e250477f78ce8dcd95e1288bff140ff521a2a775641e8e41df2ed1087: Status 404 returned error can't find the container with id c8d0349e250477f78ce8dcd95e1288bff140ff521a2a775641e8e41df2ed1087
Jul 24 18:40:13.796949 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.796928    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w6f57"
Jul 24 18:40:13.803923 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:13.803897    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414eeb11_c8ea_4e69_8329_2b1049e7c893.slice/crio-de885d6e6c0e925beb0fe57a7d39f8d6bb79b157571e016f6a46c3f8328f7a02 WatchSource:0}: Error finding container de885d6e6c0e925beb0fe57a7d39f8d6bb79b157571e016f6a46c3f8328f7a02: Status 404 returned error can't find the container with id de885d6e6c0e925beb0fe57a7d39f8d6bb79b157571e016f6a46c3f8328f7a02
Jul 24 18:40:13.809462 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.809441    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:13.816918 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:13.816894    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdfabff3_effc_4bd5_9524_c81c39646750.slice/crio-6fe3247d7cac98a10d54da245e540c305cf54254cd8e1155c99cf443f15311a8 WatchSource:0}: Error finding container 6fe3247d7cac98a10d54da245e540c305cf54254cd8e1155c99cf443f15311a8: Status 404 returned error can't find the container with id 6fe3247d7cac98a10d54da245e540c305cf54254cd8e1155c99cf443f15311a8
Jul 24 18:40:13.832425 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.832395    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-92g8s"
Jul 24 18:40:13.839923 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:13.839898    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bde3e8b_ad6d_4511_b005_247c8795a9d2.slice/crio-5f517a5625255fd85720dfc9eda88db3f4984ca55059cca89d8be72e70c2a7f5 WatchSource:0}: Error finding container 5f517a5625255fd85720dfc9eda88db3f4984ca55059cca89d8be72e70c2a7f5: Status 404 returned error can't find the container with id 5f517a5625255fd85720dfc9eda88db3f4984ca55059cca89d8be72e70c2a7f5
Jul 24 18:40:13.843996 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.843978    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vn4mn"
Jul 24 18:40:13.850963 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:13.850939    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae39ad6_5c21_4f9a_859f_1c142c64984d.slice/crio-ac2655e8ee3b72238332105e905d5b8b824c12997a98954ae97ec502c51dfb05 WatchSource:0}: Error finding container ac2655e8ee3b72238332105e905d5b8b824c12997a98954ae97ec502c51dfb05: Status 404 returned error can't find the container with id ac2655e8ee3b72238332105e905d5b8b824c12997a98954ae97ec502c51dfb05
Jul 24 18:40:13.868562 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.868530    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5ggwk"
Jul 24 18:40:13.876517 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:13.876483    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184fa814_8fa0_4d76_91ce_aa242fb35a0e.slice/crio-5e09bea10999309046b1ca7cd234fa642bfd14fa31ca68c8a212eb62b8fb5436 WatchSource:0}: Error finding container 5e09bea10999309046b1ca7cd234fa642bfd14fa31ca68c8a212eb62b8fb5436: Status 404 returned error can't find the container with id 5e09bea10999309046b1ca7cd234fa642bfd14fa31ca68c8a212eb62b8fb5436
Jul 24 18:40:13.883150 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.883132    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z257x"
Jul 24 18:40:13.888510 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.888420    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gf7wk"
Jul 24 18:40:13.890785 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:13.890762    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91380c7b_338f_4901_85e1_125ddf986c88.slice/crio-0da8bc5978d19ddacb5c3610d142c26cb0f8ef5a7b0c7a1bcd3fa9f83f9fd8f3 WatchSource:0}: Error finding container 0da8bc5978d19ddacb5c3610d142c26cb0f8ef5a7b0c7a1bcd3fa9f83f9fd8f3: Status 404 returned error can't find the container with id 0da8bc5978d19ddacb5c3610d142c26cb0f8ef5a7b0c7a1bcd3fa9f83f9fd8f3
Jul 24 18:40:13.897883 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:13.897861    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9fb4e8_7a2d_44ae_a172_437960383a64.slice/crio-11392dd8736d94d49dfd00aa83cb8110dbe7de912d7209f5016cd5d2209c777b WatchSource:0}: Error finding container 11392dd8736d94d49dfd00aa83cb8110dbe7de912d7209f5016cd5d2209c777b: Status 404 returned error can't find the container with id 11392dd8736d94d49dfd00aa83cb8110dbe7de912d7209f5016cd5d2209c777b
Jul 24 18:40:13.935464 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:13.935428    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:14.053472 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.053368    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:14.053472 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.053429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:14.053683 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:14.053536    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:14.053683 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:14.053544    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:14.053683 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:14.053589    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs podName:251138c6-eb4c-4212-963c-dc993e074afc nodeName:}" failed. No retries permitted until 2026-07-24 18:40:15.053575026 +0000 UTC m=+2.978527598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs") pod "network-metrics-daemon-slqg5" (UID: "251138c6-eb4c-4212-963c-dc993e074afc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:14.053683 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:14.053603    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret podName:49c8a3c7-ccf6-48e8-9df2-4b2621742cbd nodeName:}" failed. No retries permitted until 2026-07-24 18:40:15.053595691 +0000 UTC m=+2.978548263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret") pod "global-pull-secret-syncer-ms8c7" (UID: "49c8a3c7-ccf6-48e8-9df2-4b2621742cbd") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:14.154387 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.154332    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjttd\" (UniqueName: \"kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd\") pod \"network-check-target-nqrpk\" (UID: \"d145a150-338b-4594-a4b0-be93638911aa\") " pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:14.154663 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:14.154628    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:14.154663 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:14.154660    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:14.154814 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:14.154676    2557 projected.go:196] Error preparing data for projected volume kube-api-access-rjttd for pod openshift-network-diagnostics/network-check-target-nqrpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:14.154814 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:14.154745    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd podName:d145a150-338b-4594-a4b0-be93638911aa nodeName:}" failed. No retries permitted until 2026-07-24 18:40:15.154724181 +0000 UTC m=+3.079676768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjttd" (UniqueName: "kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd") pod "network-check-target-nqrpk" (UID: "d145a150-338b-4594-a4b0-be93638911aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:14.481517 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.481425    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 18:35:13 +0000 UTC" deadline="2028-03-16 18:15:01.792456558 +0000 UTC"
Jul 24 18:40:14.481517 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.481512    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14423h34m47.310949621s"
Jul 24 18:40:14.618190 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.618155    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:14.618391 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:14.618309    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:14.653528 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.653461    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27" event={"ID":"230149d3-0a9a-4f7b-ab85-97ea950c0e5c","Type":"ContainerStarted","Data":"c8d0349e250477f78ce8dcd95e1288bff140ff521a2a775641e8e41df2ed1087"}
Jul 24 18:40:14.654272 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.653756    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:14.679321 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.679281    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-149.ec2.internal" event={"ID":"9603afaddd1d6ed200ec863aca53bb00","Type":"ContainerStarted","Data":"d6615dc674bdafc79d49d23113c0cee95f1e11e8a24be9f29e184a46126f53c4"}
Jul 24 18:40:14.688240 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.688197    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z257x" event={"ID":"91380c7b-338f-4901-85e1-125ddf986c88","Type":"ContainerStarted","Data":"0da8bc5978d19ddacb5c3610d142c26cb0f8ef5a7b0c7a1bcd3fa9f83f9fd8f3"}
Jul 24 18:40:14.701167 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.701124    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-92g8s" event={"ID":"2bde3e8b-ad6d-4511-b005-247c8795a9d2","Type":"ContainerStarted","Data":"5f517a5625255fd85720dfc9eda88db3f4984ca55059cca89d8be72e70c2a7f5"}
Jul 24 18:40:14.718742 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.718276    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w6f57" event={"ID":"414eeb11-c8ea-4e69-8329-2b1049e7c893","Type":"ContainerStarted","Data":"de885d6e6c0e925beb0fe57a7d39f8d6bb79b157571e016f6a46c3f8328f7a02"}
Jul 24 18:40:14.736728 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.736486    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-54spr" event={"ID":"f406878b-57b2-47b8-87f0-f682f054d494","Type":"ContainerStarted","Data":"193c8dabc28a911915a0b1187f27c8d0ace7381e6a1137f0a537efc53dd4f7d5"}
Jul 24 18:40:14.767025 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.766978    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal" event={"ID":"8f5029714b837b4df73aa4ba573cdc40","Type":"ContainerStarted","Data":"fb7ae424adebf94bf36cfe421ffa1cb32e05005a8333f9bfbc464f4316a83ae8"}
Jul 24 18:40:14.793247 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.790910    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gf7wk" event={"ID":"6f9fb4e8-7a2d-44ae-a172-437960383a64","Type":"ContainerStarted","Data":"11392dd8736d94d49dfd00aa83cb8110dbe7de912d7209f5016cd5d2209c777b"}
Jul 24 18:40:14.799703 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.799666    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5ggwk" event={"ID":"184fa814-8fa0-4d76-91ce-aa242fb35a0e","Type":"ContainerStarted","Data":"5e09bea10999309046b1ca7cd234fa642bfd14fa31ca68c8a212eb62b8fb5436"}
Jul 24 18:40:14.812399 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.812347    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn4mn" event={"ID":"eae39ad6-5c21-4f9a-859f-1c142c64984d","Type":"ContainerStarted","Data":"ac2655e8ee3b72238332105e905d5b8b824c12997a98954ae97ec502c51dfb05"}
Jul 24 18:40:14.834818 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:14.834767    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq" event={"ID":"bdfabff3-effc-4bd5-9524-c81c39646750","Type":"ContainerStarted","Data":"6fe3247d7cac98a10d54da245e540c305cf54254cd8e1155c99cf443f15311a8"}
Jul 24 18:40:15.063187 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:15.063094    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:15.063187 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:15.063185    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:15.063449 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:15.063245    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:15.063449 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:15.063287    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:15.063449 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:15.063326    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs podName:251138c6-eb4c-4212-963c-dc993e074afc nodeName:}" failed. No retries permitted until 2026-07-24 18:40:17.063299731 +0000 UTC m=+4.988252321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs") pod "network-metrics-daemon-slqg5" (UID: "251138c6-eb4c-4212-963c-dc993e074afc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:15.063449 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:15.063346    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret podName:49c8a3c7-ccf6-48e8-9df2-4b2621742cbd nodeName:}" failed. No retries permitted until 2026-07-24 18:40:17.06333607 +0000 UTC m=+4.988288647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret") pod "global-pull-secret-syncer-ms8c7" (UID: "49c8a3c7-ccf6-48e8-9df2-4b2621742cbd") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:15.164236 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:15.164190    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjttd\" (UniqueName: \"kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd\") pod \"network-check-target-nqrpk\" (UID: \"d145a150-338b-4594-a4b0-be93638911aa\") " pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:15.164457 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:15.164438    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:15.164528 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:15.164464    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:15.164528 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:15.164477    2557 projected.go:196] Error preparing data for projected volume kube-api-access-rjttd for pod openshift-network-diagnostics/network-check-target-nqrpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:15.164660 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:15.164535    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd podName:d145a150-338b-4594-a4b0-be93638911aa nodeName:}" failed. No retries permitted until 2026-07-24 18:40:17.164517822 +0000 UTC m=+5.089470409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjttd" (UniqueName: "kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd") pod "network-check-target-nqrpk" (UID: "d145a150-338b-4594-a4b0-be93638911aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:15.482355 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:15.482288    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 18:35:13 +0000 UTC" deadline="2028-01-03 07:12:33.684727698 +0000 UTC"
Jul 24 18:40:15.482355 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:15.482325    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12660h32m18.202406684s"
Jul 24 18:40:15.615992 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:15.615960    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:15.616174 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:15.616095    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:15.616242 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:15.616178    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:15.616288 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:15.616251    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:16.363263 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:16.363230    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:16.615800 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:16.615716    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:16.616303 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:16.615855    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:17.080812 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:17.080773    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:17.080997 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:17.080842    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:17.080997 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:17.080971    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:17.081111 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:17.081037    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs podName:251138c6-eb4c-4212-963c-dc993e074afc nodeName:}" failed. No retries permitted until 2026-07-24 18:40:21.081016406 +0000 UTC m=+9.005968983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs") pod "network-metrics-daemon-slqg5" (UID: "251138c6-eb4c-4212-963c-dc993e074afc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:17.081111 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:17.081100    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:17.081219 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:17.081133    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret podName:49c8a3c7-ccf6-48e8-9df2-4b2621742cbd nodeName:}" failed. No retries permitted until 2026-07-24 18:40:21.081122472 +0000 UTC m=+9.006075065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret") pod "global-pull-secret-syncer-ms8c7" (UID: "49c8a3c7-ccf6-48e8-9df2-4b2621742cbd") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:17.181934 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:17.181891    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjttd\" (UniqueName: \"kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd\") pod \"network-check-target-nqrpk\" (UID: \"d145a150-338b-4594-a4b0-be93638911aa\") " pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:17.182217 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:17.182195    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:17.182314 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:17.182227    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:17.182314 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:17.182239    2557 projected.go:196] Error preparing data for projected volume kube-api-access-rjttd for pod openshift-network-diagnostics/network-check-target-nqrpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:17.182314 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:17.182301    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd podName:d145a150-338b-4594-a4b0-be93638911aa nodeName:}" failed. No retries permitted until 2026-07-24 18:40:21.182281218 +0000 UTC m=+9.107233814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjttd" (UniqueName: "kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd") pod "network-check-target-nqrpk" (UID: "d145a150-338b-4594-a4b0-be93638911aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:17.615871 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:17.615834    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:17.616357 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:17.615966    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:17.616357 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:17.616024    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:17.616357 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:17.616114    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:18.617063 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:18.617021    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:18.617574 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:18.617151    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:19.616257 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:19.616213    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:19.616473 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:19.616398    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:19.616557 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:19.616494    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:19.616641 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:19.616613    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:20.615874 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:20.615840    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:20.616335 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:20.615966    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:21.113151 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:21.113083    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:21.113151 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:21.113151    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:21.113410 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:21.113333    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:21.113479 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:21.113412    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs podName:251138c6-eb4c-4212-963c-dc993e074afc nodeName:}" failed. No retries permitted until 2026-07-24 18:40:29.113392805 +0000 UTC m=+17.038345397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs") pod "network-metrics-daemon-slqg5" (UID: "251138c6-eb4c-4212-963c-dc993e074afc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:21.113479 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:21.113426    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:21.113479 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:21.113464    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret podName:49c8a3c7-ccf6-48e8-9df2-4b2621742cbd nodeName:}" failed. No retries permitted until 2026-07-24 18:40:29.113453492 +0000 UTC m=+17.038406080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret") pod "global-pull-secret-syncer-ms8c7" (UID: "49c8a3c7-ccf6-48e8-9df2-4b2621742cbd") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:21.214468 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:21.214434    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjttd\" (UniqueName: \"kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd\") pod \"network-check-target-nqrpk\" (UID: \"d145a150-338b-4594-a4b0-be93638911aa\") " pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:21.214673 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:21.214642    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:21.214752 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:21.214678    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:21.214752 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:21.214691    2557 projected.go:196] Error preparing data for projected volume kube-api-access-rjttd for pod openshift-network-diagnostics/network-check-target-nqrpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:21.214863 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:21.214756    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd podName:d145a150-338b-4594-a4b0-be93638911aa nodeName:}" failed. No retries permitted until 2026-07-24 18:40:29.214738141 +0000 UTC m=+17.139690714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjttd" (UniqueName: "kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd") pod "network-check-target-nqrpk" (UID: "d145a150-338b-4594-a4b0-be93638911aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:21.615943 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:21.615476    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:21.615943 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:21.615624    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:21.615943 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:21.615803    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:21.615943 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:21.615906    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:22.617618 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:22.617136    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:22.617618 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:22.617246    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:23.615460 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:23.615423    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:23.615633 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:23.615423    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:23.615633 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:23.615551    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:23.615633 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:23.615575    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:24.615657 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:24.615620    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:24.616097 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:24.615753    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:25.615856 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:25.615824    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:25.616235 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:25.615824    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:25.616235 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:25.615938    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:25.616235 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:25.616040    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:26.615815 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:26.615778    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:26.615969 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:26.615919    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:27.616282 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:27.616229    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:27.616282 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:27.616276    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:27.616797 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:27.616394    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:27.616797 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:27.616483    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:28.615818 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:28.615781    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:28.616009 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:28.615892    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:29.176488 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:29.176446    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:29.177035 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:29.176540    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:29.177035 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:29.176612    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:29.177035 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:29.176628    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:29.177035 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:29.176684    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs podName:251138c6-eb4c-4212-963c-dc993e074afc nodeName:}" failed. No retries permitted until 2026-07-24 18:40:45.176664916 +0000 UTC m=+33.101617507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs") pod "network-metrics-daemon-slqg5" (UID: "251138c6-eb4c-4212-963c-dc993e074afc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:29.177035 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:29.176704    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret podName:49c8a3c7-ccf6-48e8-9df2-4b2621742cbd nodeName:}" failed. No retries permitted until 2026-07-24 18:40:45.176694373 +0000 UTC m=+33.101646946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret") pod "global-pull-secret-syncer-ms8c7" (UID: "49c8a3c7-ccf6-48e8-9df2-4b2621742cbd") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:29.277483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:29.277441    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjttd\" (UniqueName: \"kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd\") pod \"network-check-target-nqrpk\" (UID: \"d145a150-338b-4594-a4b0-be93638911aa\") " pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:29.277673 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:29.277606    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:29.277673 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:29.277626    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:29.277673 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:29.277636    2557 projected.go:196] Error preparing data for projected volume kube-api-access-rjttd for pod openshift-network-diagnostics/network-check-target-nqrpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:29.277775 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:29.277689    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd podName:d145a150-338b-4594-a4b0-be93638911aa nodeName:}" failed. No retries permitted until 2026-07-24 18:40:45.277672569 +0000 UTC m=+33.202625161 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjttd" (UniqueName: "kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd") pod "network-check-target-nqrpk" (UID: "d145a150-338b-4594-a4b0-be93638911aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:29.615425 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:29.615393    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:29.615644 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:29.615516    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:29.615644 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:29.615554    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:29.615644 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:29.615639    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:30.616186 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:30.616143    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:30.616680 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:30.616282    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:31.616223 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:31.616181    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:31.616739 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:31.616208    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:31.616739 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:31.616348    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:31.616739 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:31.616438    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:32.617346 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:32.617302    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:32.617792 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:32.617443    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:33.615585 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:33.615549    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:33.615751 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:33.615550    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:33.615751 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:33.615653    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:33.615751 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:33.615733    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:34.617816 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.617581    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:34.618421 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:34.617939    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:34.886156 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.886117    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-149.ec2.internal" event={"ID":"9603afaddd1d6ed200ec863aca53bb00","Type":"ContainerStarted","Data":"dcddc4229b8c1faa22fe20e4fa604ad945ab0a14faaa90a50723420d36037cd9"}
Jul 24 18:40:34.887792 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.887761    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-92g8s" event={"ID":"2bde3e8b-ad6d-4511-b005-247c8795a9d2","Type":"ContainerStarted","Data":"6060fd08fd94b7d247646534d9a384054036829f1ae02105f7e2461e95a3c488"}
Jul 24 18:40:34.889175 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.889146    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w6f57" event={"ID":"414eeb11-c8ea-4e69-8329-2b1049e7c893","Type":"ContainerStarted","Data":"68ecae59910107ff54332e5abb40f70441ccf16e66fe7f65ae367add5e44d3d3"}
Jul 24 18:40:34.890800 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.890778    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-54spr" event={"ID":"f406878b-57b2-47b8-87f0-f682f054d494","Type":"ContainerStarted","Data":"3e5e49eb38842dbd2dfb6ba99cacb613bc36ee67d7c5109c0eb2d33271be1fab"}
Jul 24 18:40:34.892463 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.892435    2557 generic.go:356] "Generic (PLEG): container finished" podID="8f5029714b837b4df73aa4ba573cdc40" containerID="b03d5676f774f9423e4045b1514aa908d3e2b56c180d1bf568ec7800d26d5899" exitCode=0
Jul 24 18:40:34.892552 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.892510    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal" event={"ID":"8f5029714b837b4df73aa4ba573cdc40","Type":"ContainerDied","Data":"b03d5676f774f9423e4045b1514aa908d3e2b56c180d1bf568ec7800d26d5899"}
Jul 24 18:40:34.894044 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.894021    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gf7wk" event={"ID":"6f9fb4e8-7a2d-44ae-a172-437960383a64","Type":"ContainerStarted","Data":"cf1d962d6d034bc0407b254a8b7ab137a81761349f4dd49a69c46a5e020e637c"}
Jul 24 18:40:34.895541 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.895505    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5ggwk" event={"ID":"184fa814-8fa0-4d76-91ce-aa242fb35a0e","Type":"ContainerStarted","Data":"a6220c0f7368850ca960df6c2efb5bca8570b82ff644186421d96b6a3d513b32"}
Jul 24 18:40:34.897184 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.897161    2557 generic.go:356] "Generic (PLEG): container finished" podID="eae39ad6-5c21-4f9a-859f-1c142c64984d" containerID="f5ef70cf59626e06bbe226b6bc694a9c27f621d913f008f846f6a84a6d0e652a" exitCode=0
Jul 24 18:40:34.897280 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.897233    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn4mn" event={"ID":"eae39ad6-5c21-4f9a-859f-1c142c64984d","Type":"ContainerDied","Data":"f5ef70cf59626e06bbe226b6bc694a9c27f621d913f008f846f6a84a6d0e652a"}
Jul 24 18:40:34.900803 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.900699    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-149.ec2.internal" podStartSLOduration=21.900680933 podStartE2EDuration="21.900680933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:34.899955249 +0000 UTC m=+22.824907844" watchObservedRunningTime="2026-07-24 18:40:34.900680933 +0000 UTC m=+22.825633529"
Jul 24 18:40:34.901390 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.901347    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq" event={"ID":"bdfabff3-effc-4bd5-9524-c81c39646750","Type":"ContainerStarted","Data":"a173262fde4975b19ccc293e3adf0f667fdb92faa6c7ad51050c5db0921902ad"}
Jul 24 18:40:34.901489 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.901448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq" event={"ID":"bdfabff3-effc-4bd5-9524-c81c39646750","Type":"ContainerStarted","Data":"bcd7c3e6cfd982299a814d5572368da4da77a93efb94f2a4f3eec2f162c4e31d"}
Jul 24 18:40:34.901540 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.901505    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq" event={"ID":"bdfabff3-effc-4bd5-9524-c81c39646750","Type":"ContainerStarted","Data":"a10af3dcae37bc5657481cd460233881f14ebb4fa8b0f0d947951b3d6607bec9"}
Jul 24 18:40:34.901589 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.901561    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq" event={"ID":"bdfabff3-effc-4bd5-9524-c81c39646750","Type":"ContainerStarted","Data":"eecb93496fcc5efe120aeb9ab3aef1ba28f47a16383ead6708ddc6fc846b37b5"}
Jul 24 18:40:34.901641 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.901622    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq" event={"ID":"bdfabff3-effc-4bd5-9524-c81c39646750","Type":"ContainerStarted","Data":"abb71f25f3efe12e0f5de54c0bd9b8fc0cb9faf7176a5b79e83fcbc34002f006"}
Jul 24 18:40:34.901692 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.901671    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq" event={"ID":"bdfabff3-effc-4bd5-9524-c81c39646750","Type":"ContainerStarted","Data":"8d4a819506e4cf22ddd9eac1e56f626c2cc389586712e53fa7fdbb57be65bba2"}
Jul 24 18:40:34.902843 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.902819    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27" event={"ID":"230149d3-0a9a-4f7b-ab85-97ea950c0e5c","Type":"ContainerStarted","Data":"0e3229bbfe3b7bd1fe85700789137bc270dfad0313e35692f2712d33aafb0407"}
Jul 24 18:40:34.915156 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.915076    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-54spr" podStartSLOduration=2.785984293 podStartE2EDuration="22.91506339s" totalImagesPullingTime="20.129079097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:34.914928477 +0000 UTC m=+22.839881072" watchObservedRunningTime="2026-07-24 18:40:34.91506339 +0000 UTC m=+22.840015984"
Jul 24 18:40:34.949144 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.949093    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w6f57" podStartSLOduration=2.83419183 podStartE2EDuration="22.949078533s" totalImagesPullingTime="20.114886703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:34.930477703 +0000 UTC m=+22.855430297" watchObservedRunningTime="2026-07-24 18:40:34.949078533 +0000 UTC m=+22.874031128"
Jul 24 18:40:34.963634 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.963588    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5ggwk" podStartSLOduration=2.957649911 podStartE2EDuration="22.963573427s" totalImagesPullingTime="20.005923516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:34.948795966 +0000 UTC m=+22.873748560" watchObservedRunningTime="2026-07-24 18:40:34.963573427 +0000 UTC m=+22.888526021"
Jul 24 18:40:34.980267 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.980224    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gf7wk" podStartSLOduration=2.995324032 podStartE2EDuration="22.980209954s" totalImagesPullingTime="19.984885922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:34.963202158 +0000 UTC m=+22.888154753" watchObservedRunningTime="2026-07-24 18:40:34.980209954 +0000 UTC m=+22.905162547"
Jul 24 18:40:34.980438 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:34.980407    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-92g8s" podStartSLOduration=2.86763744 podStartE2EDuration="22.980398589s" totalImagesPullingTime="20.112761149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:34.980035298 +0000 UTC m=+22.904987893" watchObservedRunningTime="2026-07-24 18:40:34.980398589 +0000 UTC m=+22.905351181"
Jul 24 18:40:35.484665 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:35.484461    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5ggwk"
Jul 24 18:40:35.615807 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:35.615772    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:35.615952 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:35.615773    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:35.615952 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:35.615912    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:35.616044 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:35.615940    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:35.906645 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:35.906529    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z257x" event={"ID":"91380c7b-338f-4901-85e1-125ddf986c88","Type":"ContainerStarted","Data":"451563792d2988ea15dc97a5fb640d9ac6a02fb31647fedd16c6e037b9c3d83f"}
Jul 24 18:40:35.937433 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:35.937364    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z257x" podStartSLOduration=3.91383634 podStartE2EDuration="23.937347798s" totalImagesPullingTime="20.023511458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:35.937181572 +0000 UTC m=+23.862134165" watchObservedRunningTime="2026-07-24 18:40:35.937347798 +0000 UTC m=+23.862300391"
Jul 24 18:40:36.084936 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.084891    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:36.125496 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.125422    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 18:40:36.164444 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.164341    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:36.421677 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.421595    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5ggwk"
Jul 24 18:40:36.422312 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.422288    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5ggwk"
Jul 24 18:40:36.508129 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.507975    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T18:40:36.125445045Z","UUID":"679b69c2-09e8-4096-810f-107b8a261731","Handler":null,"Name":"","Endpoint":""}
Jul 24 18:40:36.509684 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.509665    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 18:40:36.509830 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.509707    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 18:40:36.616501 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.616456    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:36.616722 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:36.616606    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:36.911998 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.911959    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27" event={"ID":"230149d3-0a9a-4f7b-ab85-97ea950c0e5c","Type":"ContainerStarted","Data":"5e715467bfb19fbfab906aa3806c282169878eae44bbeba23b5030886f690682"}
Jul 24 18:40:36.914242 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.914208    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal" event={"ID":"8f5029714b837b4df73aa4ba573cdc40","Type":"ContainerStarted","Data":"9178eff12ee984e415dd8ee6fd467ebe99c76f56246a4b72e913ef6bf0044f70"}
Jul 24 18:40:36.915233 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.915210    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5ggwk"
Jul 24 18:40:36.929696 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.929645    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-149.ec2.internal" podStartSLOduration=23.929619019 podStartE2EDuration="23.929619019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:36.929236194 +0000 UTC m=+24.854188789" watchObservedRunningTime="2026-07-24 18:40:36.929619019 +0000 UTC m=+24.854571613"
Jul 24 18:40:36.992163 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:36.992127    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:37.616278 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:37.616238    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:37.616278 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:37.616265    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:37.616535 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:37.616391    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:37.616535 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:37.616505    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:37.919962 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:37.919922    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq" event={"ID":"bdfabff3-effc-4bd5-9524-c81c39646750","Type":"ContainerStarted","Data":"4f43c0a60c51732fd031563a8ec9b6aedc628e71ce24ed89062eb08b225dcb10"}
Jul 24 18:40:37.921843 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:37.921818    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27" event={"ID":"230149d3-0a9a-4f7b-ab85-97ea950c0e5c","Type":"ContainerStarted","Data":"c4e380758612637c547210761f67d17668ac01937db30092d32fb9c12745fec0"}
Jul 24 18:40:37.938446 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:37.938399    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bt27" podStartSLOduration=3.180652651 podStartE2EDuration="25.938366923s" totalImagesPullingTime="22.757714272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:37.9382218 +0000 UTC m=+25.863174394" watchObservedRunningTime="2026-07-24 18:40:37.938366923 +0000 UTC m=+25.863319516"
Jul 24 18:40:38.615897 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:38.615863    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:38.616094 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:38.615991    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:39.616234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:39.615456    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:39.616234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:39.615447    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:39.616234 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:39.615742    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:39.616234 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:39.615816    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:39.928664 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:39.928633    2557 generic.go:356] "Generic (PLEG): container finished" podID="eae39ad6-5c21-4f9a-859f-1c142c64984d" containerID="16e6e37dd600f07377a0ab791f5bc2d1190c57a18b6ba15842c2f684c7843fea" exitCode=0
Jul 24 18:40:39.928825 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:39.928728    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn4mn" event={"ID":"eae39ad6-5c21-4f9a-859f-1c142c64984d","Type":"ContainerDied","Data":"16e6e37dd600f07377a0ab791f5bc2d1190c57a18b6ba15842c2f684c7843fea"}
Jul 24 18:40:39.932548 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:39.932519    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq" event={"ID":"bdfabff3-effc-4bd5-9524-c81c39646750","Type":"ContainerStarted","Data":"c19f3de491bde7e0fb71dbda52b501c2e9e5a59fb9273daca0f3b8ab244db2f9"}
Jul 24 18:40:39.932847 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:39.932826    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:39.932958 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:39.932916    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:39.948508 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:39.948484    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:39.952823 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:39.952804    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:39.976896 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:39.976846    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq" podStartSLOduration=7.644027892 podStartE2EDuration="27.976831858s" totalImagesPullingTime="20.332803966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:39.97640953 +0000 UTC m=+27.901362123" watchObservedRunningTime="2026-07-24 18:40:39.976831858 +0000 UTC m=+27.901784451"
Jul 24 18:40:40.085061 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:40.084950    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:40.185297 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:40.185263    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:40.511091 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:40.511053    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:40.566213 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:40.566179    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:40.615938 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:40.615908    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:40.616105 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:40.616020    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:40.632236 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:40.632200    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:40.934548 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:40.934481    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 18:40:41.616062 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:41.615888    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:41.616226 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:41.615942    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:41.616226 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:41.616134    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:41.616299 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:41.616228    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:41.809489 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:41.809455    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nqrpk"]
Jul 24 18:40:41.810071 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:41.809568    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:41.810071 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:41.809662    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:41.812106 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:41.812080    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ms8c7"]
Jul 24 18:40:41.823720 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:41.823638    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-slqg5"]
Jul 24 18:40:41.938622 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:41.938580    2557 generic.go:356] "Generic (PLEG): container finished" podID="eae39ad6-5c21-4f9a-859f-1c142c64984d" containerID="dc3a99cb37b9a66437fb4347e48d2380b5e265d194776b033570b252d6aae01c" exitCode=0
Jul 24 18:40:41.938814 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:41.938643    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn4mn" event={"ID":"eae39ad6-5c21-4f9a-859f-1c142c64984d","Type":"ContainerDied","Data":"dc3a99cb37b9a66437fb4347e48d2380b5e265d194776b033570b252d6aae01c"}
Jul 24 18:40:41.938814 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:41.938672    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:41.938814 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:41.938736    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 18:40:41.938814 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:41.938731    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:41.939110 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:41.938818    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:41.939294 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:41.939270    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:42.389781 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:42.389747    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:40:43.616268 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:43.616191    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:43.616675 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:43.616296    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:43.616675 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:43.616319    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:43.616675 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:43.616300    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:43.616675 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:43.616439    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:43.616675 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:43.616539    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:43.945955 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:43.945880    2557 generic.go:356] "Generic (PLEG): container finished" podID="eae39ad6-5c21-4f9a-859f-1c142c64984d" containerID="96793b54159c9a66413c1fc67cd8463bdfaa17e854b922ddf0c0da3dd2e89844" exitCode=0
Jul 24 18:40:43.945955 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:43.945935    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn4mn" event={"ID":"eae39ad6-5c21-4f9a-859f-1c142c64984d","Type":"ContainerDied","Data":"96793b54159c9a66413c1fc67cd8463bdfaa17e854b922ddf0c0da3dd2e89844"}
Jul 24 18:40:45.195944 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:45.195693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:45.196453 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:45.195857    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:45.196453 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:45.196084    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs podName:251138c6-eb4c-4212-963c-dc993e074afc nodeName:}" failed. No retries permitted until 2026-07-24 18:41:17.196064234 +0000 UTC m=+65.121016809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs") pod "network-metrics-daemon-slqg5" (UID: "251138c6-eb4c-4212-963c-dc993e074afc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:45.196453 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:45.196089    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:45.196453 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:45.196012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:45.196453 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:45.196138    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret podName:49c8a3c7-ccf6-48e8-9df2-4b2621742cbd nodeName:}" failed. No retries permitted until 2026-07-24 18:41:17.196122287 +0000 UTC m=+65.121074859 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret") pod "global-pull-secret-syncer-ms8c7" (UID: "49c8a3c7-ccf6-48e8-9df2-4b2621742cbd") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:45.296730 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:45.296691    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjttd\" (UniqueName: \"kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd\") pod \"network-check-target-nqrpk\" (UID: \"d145a150-338b-4594-a4b0-be93638911aa\") " pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:45.296925 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:45.296888    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:45.296925 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:45.296914    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:45.296925 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:45.296928    2557 projected.go:196] Error preparing data for projected volume kube-api-access-rjttd for pod openshift-network-diagnostics/network-check-target-nqrpk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:45.297074 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:45.296996    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd podName:d145a150-338b-4594-a4b0-be93638911aa nodeName:}" failed. No retries permitted until 2026-07-24 18:41:17.296974193 +0000 UTC m=+65.221926778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjttd" (UniqueName: "kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd") pod "network-check-target-nqrpk" (UID: "d145a150-338b-4594-a4b0-be93638911aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:45.615473 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:45.615431    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:45.615473 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:45.615447    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:45.615473 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:45.615462    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:45.615757 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:45.615563    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:45.615757 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:45.615620    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:45.615757 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:45.615704    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:47.615795 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.615756    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:47.616228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.615873    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:47.616228 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.615880    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:47.616228 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:47.615984    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqrpk" podUID="d145a150-338b-4594-a4b0-be93638911aa"
Jul 24 18:40:47.616228 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:47.616059    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slqg5" podUID="251138c6-eb4c-4212-963c-dc993e074afc"
Jul 24 18:40:47.616228 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:47.615877    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ms8c7" podUID="49c8a3c7-ccf6-48e8-9df2-4b2621742cbd"
Jul 24 18:40:47.909636 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.909556    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-149.ec2.internal" event="NodeReady"
Jul 24 18:40:47.909794 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.909712    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 18:40:47.916164 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.916138    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:47.956074 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.955191    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fpk2x"]
Jul 24 18:40:47.958042 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.958018    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gnms9"]
Jul 24 18:40:47.958197 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.958096    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:47.959899 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.959879    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gnms9"
Jul 24 18:40:47.960626 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.960592    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 18:40:47.960758 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.960671    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 18:40:47.960815 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.960783    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nwwl2\""
Jul 24 18:40:47.962058 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.962038    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 18:40:47.962348 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.962321    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 18:40:47.962348 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.962334    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 18:40:47.962502 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.962342    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zw859\""
Jul 24 18:40:47.968147 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.968124    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fpk2x"]
Jul 24 18:40:47.971076 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.970889    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gnms9"]
Jul 24 18:40:47.991582 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:47.991558    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:48.018147 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.018121    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7779c2fa-1f19-42a8-b4b9-9de711267983-config-volume\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:48.018261 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.018160    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7779c2fa-1f19-42a8-b4b9-9de711267983-tmp-dir\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:48.018261 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.018196    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:48.018370 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.018327    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d4gc\" (UniqueName: \"kubernetes.io/projected/7779c2fa-1f19-42a8-b4b9-9de711267983-kube-api-access-2d4gc\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:48.119614 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.119585    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d4gc\" (UniqueName: \"kubernetes.io/projected/7779c2fa-1f19-42a8-b4b9-9de711267983-kube-api-access-2d4gc\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:48.119715 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.119620    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b555ed91-5652-45d6-ba0c-c07c6d2f9243-cert\") pod \"ingress-canary-gnms9\" (UID: \"b555ed91-5652-45d6-ba0c-c07c6d2f9243\") " pod="openshift-ingress-canary/ingress-canary-gnms9"
Jul 24 18:40:48.119715 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.119643    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5gqs\" (UniqueName: \"kubernetes.io/projected/b555ed91-5652-45d6-ba0c-c07c6d2f9243-kube-api-access-c5gqs\") pod \"ingress-canary-gnms9\" (UID: \"b555ed91-5652-45d6-ba0c-c07c6d2f9243\") " pod="openshift-ingress-canary/ingress-canary-gnms9"
Jul 24 18:40:48.119793 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.119744    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7779c2fa-1f19-42a8-b4b9-9de711267983-config-volume\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:48.119793 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.119765    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7779c2fa-1f19-42a8-b4b9-9de711267983-tmp-dir\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:48.119793 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.119785    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:48.119923 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:48.119896    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 18:40:48.119987 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:48.119977    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls podName:7779c2fa-1f19-42a8-b4b9-9de711267983 nodeName:}" failed. No retries permitted until 2026-07-24 18:40:48.619953802 +0000 UTC m=+36.544906388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls") pod "dns-default-fpk2x" (UID: "7779c2fa-1f19-42a8-b4b9-9de711267983") : secret "dns-default-metrics-tls" not found
Jul 24 18:40:48.120240 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.120213    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7779c2fa-1f19-42a8-b4b9-9de711267983-tmp-dir\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:48.120363 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.120348    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7779c2fa-1f19-42a8-b4b9-9de711267983-config-volume\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:48.130693 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.130660    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d4gc\" (UniqueName: \"kubernetes.io/projected/7779c2fa-1f19-42a8-b4b9-9de711267983-kube-api-access-2d4gc\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:48.220697 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.220673    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b555ed91-5652-45d6-ba0c-c07c6d2f9243-cert\") pod \"ingress-canary-gnms9\" (UID: \"b555ed91-5652-45d6-ba0c-c07c6d2f9243\") " pod="openshift-ingress-canary/ingress-canary-gnms9"
Jul 24 18:40:48.220818 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.220710    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5gqs\" (UniqueName: \"kubernetes.io/projected/b555ed91-5652-45d6-ba0c-c07c6d2f9243-kube-api-access-c5gqs\") pod \"ingress-canary-gnms9\" (UID: \"b555ed91-5652-45d6-ba0c-c07c6d2f9243\") " pod="openshift-ingress-canary/ingress-canary-gnms9"
Jul 24 18:40:48.223036 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.223011    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b555ed91-5652-45d6-ba0c-c07c6d2f9243-cert\") pod \"ingress-canary-gnms9\" (UID: \"b555ed91-5652-45d6-ba0c-c07c6d2f9243\") " pod="openshift-ingress-canary/ingress-canary-gnms9"
Jul 24 18:40:48.229850 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.229823    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5gqs\" (UniqueName: \"kubernetes.io/projected/b555ed91-5652-45d6-ba0c-c07c6d2f9243-kube-api-access-c5gqs\") pod \"ingress-canary-gnms9\" (UID: \"b555ed91-5652-45d6-ba0c-c07c6d2f9243\") " pod="openshift-ingress-canary/ingress-canary-gnms9"
Jul 24 18:40:48.274556 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.274519    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gnms9"
Jul 24 18:40:48.349696 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.349661    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:48.405788 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.405619    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gnms9"]
Jul 24 18:40:48.408591 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:40:48.408566    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb555ed91_5652_45d6_ba0c_c07c6d2f9243.slice/crio-008cba8279bcb4ebbedb6d69979283e5455bd9e0ab4fb5622df55c789ac03110 WatchSource:0}: Error finding container 008cba8279bcb4ebbedb6d69979283e5455bd9e0ab4fb5622df55c789ac03110: Status 404 returned error can't find the container with id 008cba8279bcb4ebbedb6d69979283e5455bd9e0ab4fb5622df55c789ac03110
Jul 24 18:40:48.417555 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.417532    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:48.624614 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.624584    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:48.625185 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:48.624739    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 18:40:48.625185 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:48.624803    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls podName:7779c2fa-1f19-42a8-b4b9-9de711267983 nodeName:}" failed. No retries permitted until 2026-07-24 18:40:49.624784767 +0000 UTC m=+37.549737356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls") pod "dns-default-fpk2x" (UID: "7779c2fa-1f19-42a8-b4b9-9de711267983") : secret "dns-default-metrics-tls" not found
Jul 24 18:40:48.962965 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.962929    2557 generic.go:356] "Generic (PLEG): container finished" podID="eae39ad6-5c21-4f9a-859f-1c142c64984d" containerID="756336daae73855cc00ce3d53cc504c4b3e06fa9030fefef2712047574f7f600" exitCode=0
Jul 24 18:40:48.963135 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.963016    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn4mn" event={"ID":"eae39ad6-5c21-4f9a-859f-1c142c64984d","Type":"ContainerDied","Data":"756336daae73855cc00ce3d53cc504c4b3e06fa9030fefef2712047574f7f600"}
Jul 24 18:40:48.964331 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:48.964309    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gnms9" event={"ID":"b555ed91-5652-45d6-ba0c-c07c6d2f9243","Type":"ContainerStarted","Data":"008cba8279bcb4ebbedb6d69979283e5455bd9e0ab4fb5622df55c789ac03110"}
Jul 24 18:40:49.045447 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.045411    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:49.147986 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.147951    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:49.615586 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.615553    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:40:49.615763 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.615667    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:40:49.615826 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.615774    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:40:49.618702 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.618676    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 18:40:49.618702 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.618694    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f8czh\""
Jul 24 18:40:49.618702 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.618701    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 18:40:49.618937 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.618769    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 18:40:49.618937 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.618827    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 18:40:49.619972 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.619953    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bhdg2\""
Jul 24 18:40:49.631965 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.631941    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:49.632246 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:49.632089    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 18:40:49.632246 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:49.632143    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls podName:7779c2fa-1f19-42a8-b4b9-9de711267983 nodeName:}" failed. No retries permitted until 2026-07-24 18:40:51.632127703 +0000 UTC m=+39.557080294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls") pod "dns-default-fpk2x" (UID: "7779c2fa-1f19-42a8-b4b9-9de711267983") : secret "dns-default-metrics-tls" not found
Jul 24 18:40:49.971608 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.971568    2557 generic.go:356] "Generic (PLEG): container finished" podID="eae39ad6-5c21-4f9a-859f-1c142c64984d" containerID="7ebff908dd057b7bd1259e78320d7260f28b58f89d5e522e3d8db6bab86242fa" exitCode=0
Jul 24 18:40:49.971824 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:49.971644    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn4mn" event={"ID":"eae39ad6-5c21-4f9a-859f-1c142c64984d","Type":"ContainerDied","Data":"7ebff908dd057b7bd1259e78320d7260f28b58f89d5e522e3d8db6bab86242fa"}
Jul 24 18:40:50.977156 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:50.976978    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vn4mn" event={"ID":"eae39ad6-5c21-4f9a-859f-1c142c64984d","Type":"ContainerStarted","Data":"b41e3e87b982dd745c437e39b181a2af651c8d19d55d868601ac06d6bce4cd3a"}
Jul 24 18:40:50.978398 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:50.978361    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gnms9" event={"ID":"b555ed91-5652-45d6-ba0c-c07c6d2f9243","Type":"ContainerStarted","Data":"1ed48d466ec5f3a76a3744941dc843b0b1741da462954f4712eed9736ddc69a2"}
Jul 24 18:40:51.002451 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:51.002408    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vn4mn" podStartSLOduration=8.039418667 podStartE2EDuration="39.002367168s" totalImagesPullingTime="30.962948501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:51.001719624 +0000 UTC m=+38.926672220" watchObservedRunningTime="2026-07-24 18:40:51.002367168 +0000 UTC m=+38.927319765"
Jul 24 18:40:51.018623 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:51.018579    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gnms9" podStartSLOduration=1.912279748 podStartE2EDuration="4.018564899s" totalImagesPullingTime="2.106285151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:51.017672674 +0000 UTC m=+38.942625272" watchObservedRunningTime="2026-07-24 18:40:51.018564899 +0000 UTC m=+38.943517492"
Jul 24 18:40:51.089912 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:51.089879    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:51.151241 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:51.151209    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:51.205560 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:51.205532    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:51.582900 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:51.582863    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:51.642843 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:51.642808    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:40:51.644941 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:51.644915    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:51.645073 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:51.645057    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 18:40:51.645127 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:51.645117    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls podName:7779c2fa-1f19-42a8-b4b9-9de711267983 nodeName:}" failed. No retries permitted until 2026-07-24 18:40:55.645102598 +0000 UTC m=+43.570055174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls") pod "dns-default-fpk2x" (UID: "7779c2fa-1f19-42a8-b4b9-9de711267983") : secret "dns-default-metrics-tls" not found
Jul 24 18:40:55.677586 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:40:55.677545    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:40:55.677998 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:55.677696    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 18:40:55.677998 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:40:55.677760    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls podName:7779c2fa-1f19-42a8-b4b9-9de711267983 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:03.677745991 +0000 UTC m=+51.602698563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls") pod "dns-default-fpk2x" (UID: "7779c2fa-1f19-42a8-b4b9-9de711267983") : secret "dns-default-metrics-tls" not found
Jul 24 18:41:00.791217 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.791185    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-k4875"]
Jul 24 18:41:00.835414 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.835358    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-k4875"]
Jul 24 18:41:00.835593 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.835484    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:00.838296 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.838259    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 24 18:41:00.838442 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.838275    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nfss5\""
Jul 24 18:41:00.838442 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.838274    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 18:41:00.839349 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.839328    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 18:41:00.839457 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.839328    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 24 18:41:00.844048 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.844030    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 24 18:41:00.899475 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.899448    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"]
Jul 24 18:41:00.914006 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.913980    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wgk7v"]
Jul 24 18:41:00.914142 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.914118    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"
Jul 24 18:41:00.916762 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.916727    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 24 18:41:00.916873 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.916771    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 24 18:41:00.917163 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.917002    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 24 18:41:00.917163 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.917064    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rwj4r\""
Jul 24 18:41:00.917871 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.917848    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 24 18:41:00.928045 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.928024    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"]
Jul 24 18:41:00.928161 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.928137    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wgk7v"
Jul 24 18:41:00.930967 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.930947    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 24 18:41:00.931076 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.930967    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-msxff\""
Jul 24 18:41:00.931076 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.930999    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 24 18:41:00.946213 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.946186    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wgk7v"]
Jul 24 18:41:00.946213 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.946215    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"]
Jul 24 18:41:00.946360 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.946231    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"]
Jul 24 18:41:00.946360 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.946307    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:00.948111 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.948089    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:00.949209 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.949186    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 18:41:00.949322 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.949187    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 24 18:41:00.949322 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.949225    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 18:41:00.949429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.949399    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8rw8g\""
Jul 24 18:41:00.949523 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:00.949501    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 24 18:41:01.004269 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.004002    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"]
Jul 24 18:41:01.015677 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.015643    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90f2aede-506b-4d4f-95ce-551989d6fa89-snapshots\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.015677 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.015676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90f2aede-506b-4d4f-95ce-551989d6fa89-serving-cert\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.015859 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.015704    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90f2aede-506b-4d4f-95ce-551989d6fa89-tmp\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.015859 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.015738    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90f2aede-506b-4d4f-95ce-551989d6fa89-service-ca-bundle\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.015859 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.015803    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4564a69c-d148-4cd9-8189-b6f6099ce3fc-config\") pod \"service-ca-operator-5d6c75f84f-tnfz7\" (UID: \"4564a69c-d148-4cd9-8189-b6f6099ce3fc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"
Jul 24 18:41:01.015859 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.015836    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd8sl\" (UniqueName: \"kubernetes.io/projected/4564a69c-d148-4cd9-8189-b6f6099ce3fc-kube-api-access-bd8sl\") pod \"service-ca-operator-5d6c75f84f-tnfz7\" (UID: \"4564a69c-d148-4cd9-8189-b6f6099ce3fc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"
Jul 24 18:41:01.015981 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.015909    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4564a69c-d148-4cd9-8189-b6f6099ce3fc-serving-cert\") pod \"service-ca-operator-5d6c75f84f-tnfz7\" (UID: \"4564a69c-d148-4cd9-8189-b6f6099ce3fc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"
Jul 24 18:41:01.015981 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.015931    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90f2aede-506b-4d4f-95ce-551989d6fa89-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.015981 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.015960    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxlmb\" (UniqueName: \"kubernetes.io/projected/a138dba4-dc72-4648-b474-865744e31462-kube-api-access-dxlmb\") pod \"volume-data-source-validator-549c6d54cf-wgk7v\" (UID: \"a138dba4-dc72-4648-b474-865744e31462\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wgk7v"
Jul 24 18:41:01.016066 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.015983    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgccc\" (UniqueName: \"kubernetes.io/projected/90f2aede-506b-4d4f-95ce-551989d6fa89-kube-api-access-jgccc\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.026669 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.026639    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"]
Jul 24 18:41:01.026823 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.026757    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:01.029905 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.029884    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 24 18:41:01.030201 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.030184    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 24 18:41:01.030281 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.030226    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 24 18:41:01.030281 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.030276    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l7fhr\""
Jul 24 18:41:01.048559 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.048485    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:01.116592 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.116557    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90f2aede-506b-4d4f-95ce-551989d6fa89-tmp\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.116768 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.116601    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90f2aede-506b-4d4f-95ce-551989d6fa89-service-ca-bundle\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.116768 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.116735    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4564a69c-d148-4cd9-8189-b6f6099ce3fc-config\") pod \"service-ca-operator-5d6c75f84f-tnfz7\" (UID: \"4564a69c-d148-4cd9-8189-b6f6099ce3fc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"
Jul 24 18:41:01.116872 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.116767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd8sl\" (UniqueName: \"kubernetes.io/projected/4564a69c-d148-4cd9-8189-b6f6099ce3fc-kube-api-access-bd8sl\") pod \"service-ca-operator-5d6c75f84f-tnfz7\" (UID: \"4564a69c-d148-4cd9-8189-b6f6099ce3fc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"
Jul 24 18:41:01.116872 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.116820    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4564a69c-d148-4cd9-8189-b6f6099ce3fc-serving-cert\") pod \"service-ca-operator-5d6c75f84f-tnfz7\" (UID: \"4564a69c-d148-4cd9-8189-b6f6099ce3fc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"
Jul 24 18:41:01.116872 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.116839    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90f2aede-506b-4d4f-95ce-551989d6fa89-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.116872 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.116872    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxlmb\" (UniqueName: \"kubernetes.io/projected/a138dba4-dc72-4648-b474-865744e31462-kube-api-access-dxlmb\") pod \"volume-data-source-validator-549c6d54cf-wgk7v\" (UID: \"a138dba4-dc72-4648-b474-865744e31462\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wgk7v"
Jul 24 18:41:01.117062 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.116890    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/765f62ba-a979-469f-ad0d-bd7d2efa79d1-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:01.117062 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.116921    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgccc\" (UniqueName: \"kubernetes.io/projected/90f2aede-506b-4d4f-95ce-551989d6fa89-kube-api-access-jgccc\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.117062 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.116949    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgz66\" (UniqueName: \"kubernetes.io/projected/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-kube-api-access-pgz66\") pod \"cluster-samples-operator-6748489656-g9jr2\" (UID: \"f6a64e55-2ab4-455d-8bdc-9b2163b33be6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:01.117062 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.116997    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:01.117305 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.117285    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90f2aede-506b-4d4f-95ce-551989d6fa89-tmp\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.117305 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.117297    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90f2aede-506b-4d4f-95ce-551989d6fa89-service-ca-bundle\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.117407 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.117346    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4564a69c-d148-4cd9-8189-b6f6099ce3fc-config\") pod \"service-ca-operator-5d6c75f84f-tnfz7\" (UID: \"4564a69c-d148-4cd9-8189-b6f6099ce3fc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"
Jul 24 18:41:01.117407 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.117351    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90f2aede-506b-4d4f-95ce-551989d6fa89-snapshots\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.117529 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.117417    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90f2aede-506b-4d4f-95ce-551989d6fa89-serving-cert\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.117529 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.117476    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-g9jr2\" (UID: \"f6a64e55-2ab4-455d-8bdc-9b2163b33be6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:01.117529 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.117515    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpm89\" (UniqueName: \"kubernetes.io/projected/765f62ba-a979-469f-ad0d-bd7d2efa79d1-kube-api-access-cpm89\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:01.117778 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.117756    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90f2aede-506b-4d4f-95ce-551989d6fa89-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.117868 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.117849    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90f2aede-506b-4d4f-95ce-551989d6fa89-snapshots\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.120932 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.120910    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90f2aede-506b-4d4f-95ce-551989d6fa89-serving-cert\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.127997 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.127966    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgccc\" (UniqueName: \"kubernetes.io/projected/90f2aede-506b-4d4f-95ce-551989d6fa89-kube-api-access-jgccc\") pod \"insights-operator-5885fdb759-k4875\" (UID: \"90f2aede-506b-4d4f-95ce-551989d6fa89\") " pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.127997 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.127970    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxlmb\" (UniqueName: \"kubernetes.io/projected/a138dba4-dc72-4648-b474-865744e31462-kube-api-access-dxlmb\") pod \"volume-data-source-validator-549c6d54cf-wgk7v\" (UID: \"a138dba4-dc72-4648-b474-865744e31462\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wgk7v"
Jul 24 18:41:01.128141 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.127975    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd8sl\" (UniqueName: \"kubernetes.io/projected/4564a69c-d148-4cd9-8189-b6f6099ce3fc-kube-api-access-bd8sl\") pod \"service-ca-operator-5d6c75f84f-tnfz7\" (UID: \"4564a69c-d148-4cd9-8189-b6f6099ce3fc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"
Jul 24 18:41:01.132490 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.132465    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4564a69c-d148-4cd9-8189-b6f6099ce3fc-serving-cert\") pod \"service-ca-operator-5d6c75f84f-tnfz7\" (UID: \"4564a69c-d148-4cd9-8189-b6f6099ce3fc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"
Jul 24 18:41:01.146027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.146001    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-k4875"
Jul 24 18:41:01.218047 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.218018    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/765f62ba-a979-469f-ad0d-bd7d2efa79d1-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:01.218193 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.218057    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgz66\" (UniqueName: \"kubernetes.io/projected/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-kube-api-access-pgz66\") pod \"cluster-samples-operator-6748489656-g9jr2\" (UID: \"f6a64e55-2ab4-455d-8bdc-9b2163b33be6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:01.218193 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.218099    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:01.218193 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.218136    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-g9jr2\" (UID: \"f6a64e55-2ab4-455d-8bdc-9b2163b33be6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:01.218193 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.218163    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpm89\" (UniqueName: \"kubernetes.io/projected/765f62ba-a979-469f-ad0d-bd7d2efa79d1-kube-api-access-cpm89\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:01.218429 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:01.218258    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 18:41:01.218429 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:01.218330    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 18:41:01.218429 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:01.218332    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls podName:765f62ba-a979-469f-ad0d-bd7d2efa79d1 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:01.718316188 +0000 UTC m=+49.643268764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-kdjz5" (UID: "765f62ba-a979-469f-ad0d-bd7d2efa79d1") : secret "cluster-monitoring-operator-tls" not found
Jul 24 18:41:01.218429 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:01.218413    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls podName:f6a64e55-2ab4-455d-8bdc-9b2163b33be6 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:01.718398415 +0000 UTC m=+49.643350990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls") pod "cluster-samples-operator-6748489656-g9jr2" (UID: "f6a64e55-2ab4-455d-8bdc-9b2163b33be6") : secret "samples-operator-tls" not found
Jul 24 18:41:01.218832 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.218810    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/765f62ba-a979-469f-ad0d-bd7d2efa79d1-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:01.224265 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.224182    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"
Jul 24 18:41:01.227527 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.227497    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgz66\" (UniqueName: \"kubernetes.io/projected/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-kube-api-access-pgz66\") pod \"cluster-samples-operator-6748489656-g9jr2\" (UID: \"f6a64e55-2ab4-455d-8bdc-9b2163b33be6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:01.227656 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.227535    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpm89\" (UniqueName: \"kubernetes.io/projected/765f62ba-a979-469f-ad0d-bd7d2efa79d1-kube-api-access-cpm89\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:01.235771 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.235739    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wgk7v"
Jul 24 18:41:01.293122 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.293075    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-k4875"]
Jul 24 18:41:01.367150 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.367115    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7"]
Jul 24 18:41:01.369949 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:01.369920    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4564a69c_d148_4cd9_8189_b6f6099ce3fc.slice/crio-f54909dcf60b5c4dc626b87ec319f713c7dbd9e6c6cd802b2066ce29bebd5e9d WatchSource:0}: Error finding container f54909dcf60b5c4dc626b87ec319f713c7dbd9e6c6cd802b2066ce29bebd5e9d: Status 404 returned error can't find the container with id f54909dcf60b5c4dc626b87ec319f713c7dbd9e6c6cd802b2066ce29bebd5e9d
Jul 24 18:41:01.382466 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.382440    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wgk7v"]
Jul 24 18:41:01.385489 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:01.385465    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda138dba4_dc72_4648_b474_865744e31462.slice/crio-ad237dda3bbd16b5ed7a8baffc78e836fd904e5a80b170863820f0a447d59b55 WatchSource:0}: Error finding container ad237dda3bbd16b5ed7a8baffc78e836fd904e5a80b170863820f0a447d59b55: Status 404 returned error can't find the container with id ad237dda3bbd16b5ed7a8baffc78e836fd904e5a80b170863820f0a447d59b55
Jul 24 18:41:01.722550 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.722516    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:01.722721 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:01.722561    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-g9jr2\" (UID: \"f6a64e55-2ab4-455d-8bdc-9b2163b33be6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:01.722721 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:01.722693    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 18:41:01.722721 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:01.722714    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 18:41:01.722838 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:01.722763    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls podName:765f62ba-a979-469f-ad0d-bd7d2efa79d1 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:02.722744457 +0000 UTC m=+50.647697036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-kdjz5" (UID: "765f62ba-a979-469f-ad0d-bd7d2efa79d1") : secret "cluster-monitoring-operator-tls" not found
Jul 24 18:41:01.722838 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:01.722778    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls podName:f6a64e55-2ab4-455d-8bdc-9b2163b33be6 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:02.722770704 +0000 UTC m=+50.647723276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls") pod "cluster-samples-operator-6748489656-g9jr2" (UID: "f6a64e55-2ab4-455d-8bdc-9b2163b33be6") : secret "samples-operator-tls" not found
Jul 24 18:41:02.016763 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:02.016678    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7" event={"ID":"4564a69c-d148-4cd9-8189-b6f6099ce3fc","Type":"ContainerStarted","Data":"f54909dcf60b5c4dc626b87ec319f713c7dbd9e6c6cd802b2066ce29bebd5e9d"}
Jul 24 18:41:02.018134 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:02.018106    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wgk7v" event={"ID":"a138dba4-dc72-4648-b474-865744e31462","Type":"ContainerStarted","Data":"ad237dda3bbd16b5ed7a8baffc78e836fd904e5a80b170863820f0a447d59b55"}
Jul 24 18:41:02.019476 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:02.019446    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-k4875" event={"ID":"90f2aede-506b-4d4f-95ce-551989d6fa89","Type":"ContainerStarted","Data":"1a9b41981e02d5f503c8194b08920d356e975bed05764e690b403da3be6c70dc"}
Jul 24 18:41:02.483402 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:02.483303    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:02.584825 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:02.584724    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:02.732955 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:02.732908    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:02.733145 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:02.733062    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-g9jr2\" (UID: \"f6a64e55-2ab4-455d-8bdc-9b2163b33be6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:02.733145 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:02.733084    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 18:41:02.733256 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:02.733180    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls podName:765f62ba-a979-469f-ad0d-bd7d2efa79d1 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:04.733160715 +0000 UTC m=+52.658113287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-kdjz5" (UID: "765f62ba-a979-469f-ad0d-bd7d2efa79d1") : secret "cluster-monitoring-operator-tls" not found
Jul 24 18:41:02.733256 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:02.733237    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 18:41:02.733368 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:02.733310    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls podName:f6a64e55-2ab4-455d-8bdc-9b2163b33be6 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:04.733292378 +0000 UTC m=+52.658244956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls") pod "cluster-samples-operator-6748489656-g9jr2" (UID: "f6a64e55-2ab4-455d-8bdc-9b2163b33be6") : secret "samples-operator-tls" not found
Jul 24 18:41:03.742183 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:03.742139    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:41:03.742686 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:03.742320    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 18:41:03.742686 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:03.742413    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls podName:7779c2fa-1f19-42a8-b4b9-9de711267983 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:19.742393806 +0000 UTC m=+67.667346399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls") pod "dns-default-fpk2x" (UID: "7779c2fa-1f19-42a8-b4b9-9de711267983") : secret "dns-default-metrics-tls" not found
Jul 24 18:41:04.752989 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:04.752930    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:04.753433 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:04.752997    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-g9jr2\" (UID: \"f6a64e55-2ab4-455d-8bdc-9b2163b33be6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:04.753433 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:04.753093    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 18:41:04.753433 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:04.753161    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls podName:765f62ba-a979-469f-ad0d-bd7d2efa79d1 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:08.753144452 +0000 UTC m=+56.678097025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-kdjz5" (UID: "765f62ba-a979-469f-ad0d-bd7d2efa79d1") : secret "cluster-monitoring-operator-tls" not found
Jul 24 18:41:04.753433 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:04.753105    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 18:41:04.753433 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:04.753237    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls podName:f6a64e55-2ab4-455d-8bdc-9b2163b33be6 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:08.75322098 +0000 UTC m=+56.678173553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls") pod "cluster-samples-operator-6748489656-g9jr2" (UID: "f6a64e55-2ab4-455d-8bdc-9b2163b33be6") : secret "samples-operator-tls" not found
Jul 24 18:41:05.028233 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.028151    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wgk7v" event={"ID":"a138dba4-dc72-4648-b474-865744e31462","Type":"ContainerStarted","Data":"29b948b8de0698aa44d3fbe41e89e34477f3df02488092e9a7826cb1b8a5e5a9"}
Jul 24 18:41:05.029951 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.029917    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-k4875" event={"ID":"90f2aede-506b-4d4f-95ce-551989d6fa89","Type":"ContainerStarted","Data":"971e3193c511eb7e3be229eedc565b6892b037a21bc1dc635627f052582cf00a"}
Jul 24 18:41:05.031448 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.031421    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7" event={"ID":"4564a69c-d148-4cd9-8189-b6f6099ce3fc","Type":"ContainerStarted","Data":"0c1a2358b86a393e1cb9654bc38723daba91b34e307209539678fa9cfa34ca70"}
Jul 24 18:41:05.053026 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.052968    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-wgk7v" podStartSLOduration=2.176067591 podStartE2EDuration="5.052950042s" totalImagesPullingTime="2.876882451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:05.05248432 +0000 UTC m=+52.977436927" watchObservedRunningTime="2026-07-24 18:41:05.052950042 +0000 UTC m=+52.977902618"
Jul 24 18:41:05.071692 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.071640    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-k4875" podStartSLOduration=2.064356538 podStartE2EDuration="5.071624577s" totalImagesPullingTime="3.007268039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:05.070916435 +0000 UTC m=+52.995869029" watchObservedRunningTime="2026-07-24 18:41:05.071624577 +0000 UTC m=+52.996577171"
Jul 24 18:41:05.088477 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.088420    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7" podStartSLOduration=2.146197121 podStartE2EDuration="5.08839943s" totalImagesPullingTime="2.942202309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:05.087787539 +0000 UTC m=+53.012740133" watchObservedRunningTime="2026-07-24 18:41:05.08839943 +0000 UTC m=+53.013352021"
Jul 24 18:41:05.148847 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.148810    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:05.209403 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.209349    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:05.806951 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.806916    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nml7m"]
Jul 24 18:41:05.828631 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.828593    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.829006 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.828969    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nml7m"]
Jul 24 18:41:05.831275 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.831250    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 18:41:05.832929 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.832903    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 18:41:05.833692 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.833642    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2bkk8\""
Jul 24 18:41:05.863947 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.863906    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:05.864150 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.864089    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6949c3ad-f467-45a2-8182-8c18079f4407-data-volume\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.864150 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.864128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcghs\" (UniqueName: \"kubernetes.io/projected/6949c3ad-f467-45a2-8182-8c18079f4407-kube-api-access-hcghs\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.864265 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.864243    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.864299 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.864276    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6949c3ad-f467-45a2-8182-8c18079f4407-crio-socket\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.864476 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.864446    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.941050 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.941013    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:05.965192 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.965157    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.965192 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.965196    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6949c3ad-f467-45a2-8182-8c18079f4407-data-volume\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.965460 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.965218    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcghs\" (UniqueName: \"kubernetes.io/projected/6949c3ad-f467-45a2-8182-8c18079f4407-kube-api-access-hcghs\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.965460 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:05.965280    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 18:41:05.965460 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.965345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.965460 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:05.965357    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm podName:6949c3ad-f467-45a2-8182-8c18079f4407 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:06.465335449 +0000 UTC m=+54.390288041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nml7m" (UID: "6949c3ad-f467-45a2-8182-8c18079f4407") : configmap "kube-rbac-proxy" not found
Jul 24 18:41:05.965460 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.965413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6949c3ad-f467-45a2-8182-8c18079f4407-crio-socket\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.965460 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:05.965447    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:05.965868 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:05.965497    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls podName:6949c3ad-f467-45a2-8182-8c18079f4407 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:06.465484361 +0000 UTC m=+54.390436945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nml7m" (UID: "6949c3ad-f467-45a2-8182-8c18079f4407") : secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:05.965868 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.965534    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6949c3ad-f467-45a2-8182-8c18079f4407-crio-socket\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.965868 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.965588    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6949c3ad-f467-45a2-8182-8c18079f4407-data-volume\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:05.986066 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:05.986037    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcghs\" (UniqueName: \"kubernetes.io/projected/6949c3ad-f467-45a2-8182-8c18079f4407-kube-api-access-hcghs\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:06.073562 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:06.073480    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:06.143099 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:06.143064    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:06.243913 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:06.243879    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:06.469423 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:06.469391    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:06.469654 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:06.469454    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:06.469654 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:06.469492    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 18:41:06.469654 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:06.469539    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:06.469654 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:06.469553    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm podName:6949c3ad-f467-45a2-8182-8c18079f4407 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:07.469538539 +0000 UTC m=+55.394491111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nml7m" (UID: "6949c3ad-f467-45a2-8182-8c18079f4407") : configmap "kube-rbac-proxy" not found
Jul 24 18:41:06.469654 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:06.469579    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls podName:6949c3ad-f467-45a2-8182-8c18079f4407 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:07.469567502 +0000 UTC m=+55.394520075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nml7m" (UID: "6949c3ad-f467-45a2-8182-8c18079f4407") : secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:06.681956 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:06.679426    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:06.775614 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:06.775522    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:07.476617 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:07.476577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:07.477014 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:07.476639    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:07.477014 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:07.476706    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 18:41:07.477014 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:07.476742    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:07.477014 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:07.476777    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm podName:6949c3ad-f467-45a2-8182-8c18079f4407 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:09.476761912 +0000 UTC m=+57.401714487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nml7m" (UID: "6949c3ad-f467-45a2-8182-8c18079f4407") : configmap "kube-rbac-proxy" not found
Jul 24 18:41:07.477014 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:07.476792    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls podName:6949c3ad-f467-45a2-8182-8c18079f4407 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:09.476785775 +0000 UTC m=+57.401738347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nml7m" (UID: "6949c3ad-f467-45a2-8182-8c18079f4407") : secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:07.766498 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:07.766416    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gf7wk_6f9fb4e8-7a2d-44ae-a172-437960383a64/dns-node-resolver/0.log"
Jul 24 18:41:08.294774 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.294736    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-tzw6h"]
Jul 24 18:41:08.297210 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.297194    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h"
Jul 24 18:41:08.299930 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.299908    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 24 18:41:08.300895 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.300875    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dbbjb\""
Jul 24 18:41:08.300983 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.300880    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 24 18:41:08.301050 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.300878    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 24 18:41:08.301050 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.300881    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 24 18:41:08.307211 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.307189    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-tzw6h"]
Jul 24 18:41:08.327146 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.327121    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:08.383604 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.383570    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad359ae2-1c77-4fd8-be44-1863814821c3-signing-cabundle\") pod \"service-ca-658d7b7c78-tzw6h\" (UID: \"ad359ae2-1c77-4fd8-be44-1863814821c3\") " pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h"
Jul 24 18:41:08.383604 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.383601    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cxvf\" (UniqueName: \"kubernetes.io/projected/ad359ae2-1c77-4fd8-be44-1863814821c3-kube-api-access-6cxvf\") pod \"service-ca-658d7b7c78-tzw6h\" (UID: \"ad359ae2-1c77-4fd8-be44-1863814821c3\") " pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h"
Jul 24 18:41:08.383778 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.383621    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad359ae2-1c77-4fd8-be44-1863814821c3-signing-key\") pod \"service-ca-658d7b7c78-tzw6h\" (UID: \"ad359ae2-1c77-4fd8-be44-1863814821c3\") " pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h"
Jul 24 18:41:08.405689 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.405653    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:08.484694 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.484658    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad359ae2-1c77-4fd8-be44-1863814821c3-signing-cabundle\") pod \"service-ca-658d7b7c78-tzw6h\" (UID: \"ad359ae2-1c77-4fd8-be44-1863814821c3\") " pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h"
Jul 24 18:41:08.484694 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.484695    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxvf\" (UniqueName: \"kubernetes.io/projected/ad359ae2-1c77-4fd8-be44-1863814821c3-kube-api-access-6cxvf\") pod \"service-ca-658d7b7c78-tzw6h\" (UID: \"ad359ae2-1c77-4fd8-be44-1863814821c3\") " pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h"
Jul 24 18:41:08.485169 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.484719    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad359ae2-1c77-4fd8-be44-1863814821c3-signing-key\") pod \"service-ca-658d7b7c78-tzw6h\" (UID: \"ad359ae2-1c77-4fd8-be44-1863814821c3\") " pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h"
Jul 24 18:41:08.485280 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.485260    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad359ae2-1c77-4fd8-be44-1863814821c3-signing-cabundle\") pod \"service-ca-658d7b7c78-tzw6h\" (UID: \"ad359ae2-1c77-4fd8-be44-1863814821c3\") " pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h"
Jul 24 18:41:08.487096 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.487076    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad359ae2-1c77-4fd8-be44-1863814821c3-signing-key\") pod \"service-ca-658d7b7c78-tzw6h\" (UID: \"ad359ae2-1c77-4fd8-be44-1863814821c3\") " pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h"
Jul 24 18:41:08.495431 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.495396    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cxvf\" (UniqueName: \"kubernetes.io/projected/ad359ae2-1c77-4fd8-be44-1863814821c3-kube-api-access-6cxvf\") pod \"service-ca-658d7b7c78-tzw6h\" (UID: \"ad359ae2-1c77-4fd8-be44-1863814821c3\") " pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h"
Jul 24 18:41:08.567090 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.567010    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-54spr_f406878b-57b2-47b8-87f0-f682f054d494/node-ca/0.log"
Jul 24 18:41:08.576919 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.576879    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:08.606064 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.606024    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h"
Jul 24 18:41:08.689824 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.689796    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:08.726348 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.726318    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-tzw6h"]
Jul 24 18:41:08.729108 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:08.729081    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad359ae2_1c77_4fd8_be44_1863814821c3.slice/crio-631678e5dd876992808b8376740cb64be1bfd5ea197edc0e842169e78d9f8d64 WatchSource:0}: Error finding container 631678e5dd876992808b8376740cb64be1bfd5ea197edc0e842169e78d9f8d64: Status 404 returned error can't find the container with id 631678e5dd876992808b8376740cb64be1bfd5ea197edc0e842169e78d9f8d64
Jul 24 18:41:08.786586 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.786562    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-g9jr2\" (UID: \"f6a64e55-2ab4-455d-8bdc-9b2163b33be6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:08.786692 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.786617    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:08.786769 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:08.786702    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 18:41:08.786769 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:08.786714    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 18:41:08.786769 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:08.786763    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls podName:765f62ba-a979-469f-ad0d-bd7d2efa79d1 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:16.786744572 +0000 UTC m=+64.711697145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-kdjz5" (UID: "765f62ba-a979-469f-ad0d-bd7d2efa79d1") : secret "cluster-monitoring-operator-tls" not found
Jul 24 18:41:08.786874 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:08.786778    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls podName:f6a64e55-2ab4-455d-8bdc-9b2163b33be6 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:16.78677165 +0000 UTC m=+64.711724222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls") pod "cluster-samples-operator-6748489656-g9jr2" (UID: "f6a64e55-2ab4-455d-8bdc-9b2163b33be6") : secret "samples-operator-tls" not found
Jul 24 18:41:08.944321 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:08.944229    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:09.043289 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:09.043256    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h" event={"ID":"ad359ae2-1c77-4fd8-be44-1863814821c3","Type":"ContainerStarted","Data":"8ad8e02317c0e5e98ed35d2f1baf03f6c60f4f66035d6da5eab80213375d13be"}
Jul 24 18:41:09.043480 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:09.043311    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h" event={"ID":"ad359ae2-1c77-4fd8-be44-1863814821c3","Type":"ContainerStarted","Data":"631678e5dd876992808b8376740cb64be1bfd5ea197edc0e842169e78d9f8d64"}
Jul 24 18:41:09.045124 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:09.045098    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:09.148747 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:09.148705    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:09.219908 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:09.219877    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:09.389364 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:09.389334    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:09.492471 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:09.492392    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:09.492864 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:09.492511    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 18:41:09.492864 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:09.492523    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:09.492864 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:09.492570    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm podName:6949c3ad-f467-45a2-8182-8c18079f4407 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:13.492555553 +0000 UTC m=+61.417508126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nml7m" (UID: "6949c3ad-f467-45a2-8182-8c18079f4407") : configmap "kube-rbac-proxy" not found
Jul 24 18:41:09.492864 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:09.492678    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:09.492864 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:09.492726    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls podName:6949c3ad-f467-45a2-8182-8c18079f4407 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:13.492713601 +0000 UTC m=+61.417666178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nml7m" (UID: "6949c3ad-f467-45a2-8182-8c18079f4407") : secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:09.568862 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:09.568826    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gnms9_b555ed91-5652-45d6-ba0c-c07c6d2f9243/serve-healthcheck-canary/0.log"
Jul 24 18:41:10.433461 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:10.433329    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:10.567130 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:10.567062    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:10.627428 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:10.627370    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:10.773100 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:10.773067    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:10.877582 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:10.877543    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:10.981550 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:10.981520    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:11.181728 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:11.181641    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:12.137533 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:12.137499    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:12.527100 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:12.527071    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:12.726561 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:12.726511    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:12.927762 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:12.927683    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:12.960307 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:12.960280    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfctq"
Jul 24 18:41:12.994762 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:12.994686    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:12.998917 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:12.997136    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-tzw6h" podStartSLOduration=4.997116678 podStartE2EDuration="4.997116678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:09.063925586 +0000 UTC m=+56.988878177" watchObservedRunningTime="2026-07-24 18:41:12.997116678 +0000 UTC m=+60.922069272"
Jul 24 18:41:13.343006 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:13.342969    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:13.525345 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:13.525302    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:13.525541 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:13.525427    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:13.525541 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:13.525433    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 18:41:13.525541 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:13.525504    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm podName:6949c3ad-f467-45a2-8182-8c18079f4407 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:21.52548865 +0000 UTC m=+69.450441223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nml7m" (UID: "6949c3ad-f467-45a2-8182-8c18079f4407") : configmap "kube-rbac-proxy" not found
Jul 24 18:41:13.525541 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:13.525527    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:13.525709 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:13.525603    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls podName:6949c3ad-f467-45a2-8182-8c18079f4407 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:21.525587805 +0000 UTC m=+69.450540378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nml7m" (UID: "6949c3ad-f467-45a2-8182-8c18079f4407") : secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:13.816578 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:13.816526    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:14.133567 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:14.133450    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:14.193924 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:14.193884    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:14.721692 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:14.721640    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:14.778810 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:14.778752    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:15.133260 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:15.133139    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:15.326683 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:15.326651    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:15.426031 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:15.425951    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:15.728803 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:15.728774    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:16.129335 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:16.129244    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:16.522312 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:16.522277    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:16.642229 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:16.642199    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:16.851495 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:16.851412    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:16.851863 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:16.851523    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-g9jr2\" (UID: \"f6a64e55-2ab4-455d-8bdc-9b2163b33be6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:16.851863 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:16.851584    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 18:41:16.851863 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:16.851661    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls podName:765f62ba-a979-469f-ad0d-bd7d2efa79d1 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:32.85164392 +0000 UTC m=+80.776596511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-kdjz5" (UID: "765f62ba-a979-469f-ad0d-bd7d2efa79d1") : secret "cluster-monitoring-operator-tls" not found
Jul 24 18:41:16.853917 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:16.853899    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6a64e55-2ab4-455d-8bdc-9b2163b33be6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-g9jr2\" (UID: \"f6a64e55-2ab4-455d-8bdc-9b2163b33be6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:16.938656 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:16.938628    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l7fhr\""
Jul 24 18:41:16.946762 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:16.946745    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"
Jul 24 18:41:17.068486 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.068453    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2"]
Jul 24 18:41:17.128981 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.128947    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:17.255111 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.255078    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:41:17.255296 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.255128    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:41:17.257725 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.257705    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 18:41:17.257794 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.257760    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 18:41:17.265664 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:17.265645    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 18:41:17.265736 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:17.265704    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs podName:251138c6-eb4c-4212-963c-dc993e074afc nodeName:}" failed. No retries permitted until 2026-07-24 18:42:21.265689319 +0000 UTC m=+129.190641890 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs") pod "network-metrics-daemon-slqg5" (UID: "251138c6-eb4c-4212-963c-dc993e074afc") : secret "metrics-daemon-secret" not found
Jul 24 18:41:17.267787 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.267768    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49c8a3c7-ccf6-48e8-9df2-4b2621742cbd-original-pull-secret\") pod \"global-pull-secret-syncer-ms8c7\" (UID: \"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd\") " pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:41:17.356163 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.356065    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjttd\" (UniqueName: \"kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd\") pod \"network-check-target-nqrpk\" (UID: \"d145a150-338b-4594-a4b0-be93638911aa\") " pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:41:17.358943 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.358920    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 18:41:17.369176 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.369148    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 18:41:17.379788 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.379764    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjttd\" (UniqueName: \"kubernetes.io/projected/d145a150-338b-4594-a4b0-be93638911aa-kube-api-access-rjttd\") pod \"network-check-target-nqrpk\" (UID: \"d145a150-338b-4594-a4b0-be93638911aa\") " pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:41:17.526945 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.526906    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ms8c7"
Jul 24 18:41:17.536242 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.536215    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bhdg2\""
Jul 24 18:41:17.544470 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.544436    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:41:17.660796 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.660674    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ms8c7"]
Jul 24 18:41:17.663091 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:17.663054    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c8a3c7_ccf6_48e8_9df2_4b2621742cbd.slice/crio-d4cb58980a44d012704ea3da5880640827920c3408c3535e7b0fd79d59b99264 WatchSource:0}: Error finding container d4cb58980a44d012704ea3da5880640827920c3408c3535e7b0fd79d59b99264: Status 404 returned error can't find the container with id d4cb58980a44d012704ea3da5880640827920c3408c3535e7b0fd79d59b99264
Jul 24 18:41:17.682482 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.682396    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nqrpk"]
Jul 24 18:41:17.685749 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:17.685706    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd145a150_338b_4594_a4b0_be93638911aa.slice/crio-9918be644213b3d842d8f1d251075218c2577ce89e63a426920935942a47708c WatchSource:0}: Error finding container 9918be644213b3d842d8f1d251075218c2577ce89e63a426920935942a47708c: Status 404 returned error can't find the container with id 9918be644213b3d842d8f1d251075218c2577ce89e63a426920935942a47708c
Jul 24 18:41:17.720732 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.720692    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:17.922065 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:17.921944    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:18.069592 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:18.069556    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nqrpk" event={"ID":"d145a150-338b-4594-a4b0-be93638911aa","Type":"ContainerStarted","Data":"9918be644213b3d842d8f1d251075218c2577ce89e63a426920935942a47708c"}
Jul 24 18:41:18.076117 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:18.076084    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ms8c7" event={"ID":"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd","Type":"ContainerStarted","Data":"d4cb58980a44d012704ea3da5880640827920c3408c3535e7b0fd79d59b99264"}
Jul 24 18:41:18.077397 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:18.077356    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2" event={"ID":"f6a64e55-2ab4-455d-8bdc-9b2163b33be6","Type":"ContainerStarted","Data":"0b13a2ae609c144da308f4253668c4d9fe77b0f81a71d9dee1f0a07201b7f507"}
Jul 24 18:41:18.125115 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:18.125076    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:18.328613 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:18.328578    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:18.925273 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:18.925126    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:19.027368 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:19.027288    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:19.758463 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:19.758427    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:19.779930 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:19.779888    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:41:19.789518 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:19.789484    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7779c2fa-1f19-42a8-b4b9-9de711267983-metrics-tls\") pod \"dns-default-fpk2x\" (UID: \"7779c2fa-1f19-42a8-b4b9-9de711267983\") " pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:41:20.071457 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:20.071352    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nwwl2\""
Jul 24 18:41:20.078728 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:20.078694    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:41:20.087943 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:20.087902    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2" event={"ID":"f6a64e55-2ab4-455d-8bdc-9b2163b33be6","Type":"ContainerStarted","Data":"e8d6fda8730cd985008ec458c55a29d7fa44e873dc267e12365271fa1d8be882"}
Jul 24 18:41:20.088100 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:20.087971    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2" event={"ID":"f6a64e55-2ab4-455d-8bdc-9b2163b33be6","Type":"ContainerStarted","Data":"25faec57c50abb9aff4766cfc3d0e7b09c27eb0ee256de966fd02373b95f52c2"}
Jul 24 18:41:20.104653 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:20.104592    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-g9jr2" podStartSLOduration=17.866105901 podStartE2EDuration="20.104568108s" totalImagesPullingTime="2.238462207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:20.10420297 +0000 UTC m=+68.029155564" watchObservedRunningTime="2026-07-24 18:41:20.104568108 +0000 UTC m=+68.029520704"
Jul 24 18:41:20.132934 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:20.132879    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:20.331991 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:20.331897    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:20.521319 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:20.521285    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:20.582122 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:20.582039    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:20.928652 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:20.928550    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:21.129963 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:21.129928    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:21.596006 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:21.595964    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:21.596193 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:21.596043    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:21.596698 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:21.596660    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6949c3ad-f467-45a2-8182-8c18079f4407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:21.598521 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:21.598475    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6949c3ad-f467-45a2-8182-8c18079f4407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nml7m\" (UID: \"6949c3ad-f467-45a2-8182-8c18079f4407\") " pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:21.742141 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:21.741926    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2bkk8\""
Jul 24 18:41:21.750031 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:21.749995    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nml7m"
Jul 24 18:41:22.600914 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:22.600884    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fpk2x"]
Jul 24 18:41:22.604261 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:22.604231    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7779c2fa_1f19_42a8_b4b9_9de711267983.slice/crio-7cab1b61361a5ae21a9e6c667c9948a41c43d9cbe4f25923632d2758ef783461 WatchSource:0}: Error finding container 7cab1b61361a5ae21a9e6c667c9948a41c43d9cbe4f25923632d2758ef783461: Status 404 returned error can't find the container with id 7cab1b61361a5ae21a9e6c667c9948a41c43d9cbe4f25923632d2758ef783461
Jul 24 18:41:22.622368 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:22.622339    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nml7m"]
Jul 24 18:41:22.624102 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:22.624067    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6949c3ad_f467_45a2_8182_8c18079f4407.slice/crio-56eae6e94d25bfc80a3f37fce5468e570bd7b002108d6fd33240ed10981d1694 WatchSource:0}: Error finding container 56eae6e94d25bfc80a3f37fce5468e570bd7b002108d6fd33240ed10981d1694: Status 404 returned error can't find the container with id 56eae6e94d25bfc80a3f37fce5468e570bd7b002108d6fd33240ed10981d1694
Jul 24 18:41:23.103896 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:23.103726    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nqrpk" event={"ID":"d145a150-338b-4594-a4b0-be93638911aa","Type":"ContainerStarted","Data":"c370a1c9a1f407ab5a68380eacc5966e1ebcfca96dc339d5caf4d246a662fdde"}
Jul 24 18:41:23.104208 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:23.104148    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:41:23.105829 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:23.105797    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nml7m" event={"ID":"6949c3ad-f467-45a2-8182-8c18079f4407","Type":"ContainerStarted","Data":"56eae6e94d25bfc80a3f37fce5468e570bd7b002108d6fd33240ed10981d1694"}
Jul 24 18:41:23.108014 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:23.107962    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ms8c7" event={"ID":"49c8a3c7-ccf6-48e8-9df2-4b2621742cbd","Type":"ContainerStarted","Data":"59ba0a09c45edb68104bcb337f74fef6e6f0f4f2d60136f8d87035922efb3839"}
Jul 24 18:41:23.111861 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:23.111752    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fpk2x" event={"ID":"7779c2fa-1f19-42a8-b4b9-9de711267983","Type":"ContainerStarted","Data":"7cab1b61361a5ae21a9e6c667c9948a41c43d9cbe4f25923632d2758ef783461"}
Jul 24 18:41:23.122990 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:23.121446    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nqrpk" podStartSLOduration=66.353273288 podStartE2EDuration="1m11.121425021s" totalImagesPullingTime="4.768151733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:23.120425489 +0000 UTC m=+71.045378078" watchObservedRunningTime="2026-07-24 18:41:23.121425021 +0000 UTC m=+71.046377616"
Jul 24 18:41:25.128125 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:25.128084    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fpk2x" event={"ID":"7779c2fa-1f19-42a8-b4b9-9de711267983","Type":"ContainerStarted","Data":"0e9355f7519e19539ac3153370d26d062a08a8ddc87126cedda914294443dd9e"}
Jul 24 18:41:25.128586 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:25.128189    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fpk2x" event={"ID":"7779c2fa-1f19-42a8-b4b9-9de711267983","Type":"ContainerStarted","Data":"bc9e8889fe883c729ed90aab8038599fcd4b3c67ae2d2e6ce10435162d0298f5"}
Jul 24 18:41:25.128586 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:25.128240    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:41:25.145026 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:25.144977    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fpk2x" podStartSLOduration=36.316167687 podStartE2EDuration="38.144961669s" totalImagesPullingTime="1.828793982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:25.144091755 +0000 UTC m=+73.069044352" watchObservedRunningTime="2026-07-24 18:41:25.144961669 +0000 UTC m=+73.069914262"
Jul 24 18:41:25.145565 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:25.145522    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ms8c7" podStartSLOduration=68.348308221 podStartE2EDuration="1m13.145506078s" totalImagesPullingTime="4.797197857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:23.135999918 +0000 UTC m=+71.060952513" watchObservedRunningTime="2026-07-24 18:41:25.145506078 +0000 UTC m=+73.070458674"
Jul 24 18:41:25.277386 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:25.277339    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:25.378289 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:25.378209    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:27.333266 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:27.333224    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:27.433630 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:27.433595    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:27.500349 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:27.500304    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:27.626099 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:27.626064    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:28.008111 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:28.008078    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:28.067820 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:28.067783    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:28.143115 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:28.143077    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nml7m" event={"ID":"6949c3ad-f467-45a2-8182-8c18079f4407","Type":"ContainerStarted","Data":"b9e07bb21571b61c01ae13f832472ef2dbf4118653f2273100d7c086852846c9"}
Jul 24 18:41:28.419702 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:28.419613    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:28.521213 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:28.521157    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:29.074281 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.074238    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:29.143513 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.143477    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9"]
Jul 24 18:41:29.149701 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.149665    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9"
Jul 24 18:41:29.158294 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.158249    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 24 18:41:29.158451 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.158291    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-brdx2\""
Jul 24 18:41:29.159856 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.159817    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 18:41:29.162770 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.162753    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 18:41:29.168783 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.168674    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 18:41:29.169997 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.169977    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9"]
Jul 24 18:41:29.214809 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.214768    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-755b99fc9-p757p"]
Jul 24 18:41:29.219869 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.219840    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.224986 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.224954    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 18:41:29.225143 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.225006    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 18:41:29.228169 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.227908    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 18:41:29.228665 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.228644    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tlbzw\""
Jul 24 18:41:29.245722 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.245691    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 18:41:29.252964 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.252933    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-755b99fc9-p757p"]
Jul 24 18:41:29.265724 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.265531    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6af94df2-b119-4124-9b50-ec537eb46803-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5754c76c94-x5qg9\" (UID: \"6af94df2-b119-4124-9b50-ec537eb46803\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9"
Jul 24 18:41:29.265724 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.265581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7069d773-b7f5-4cf3-985b-4ae3f0740b62-ca-trust-extracted\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.265724 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.265614    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7069d773-b7f5-4cf3-985b-4ae3f0740b62-bound-sa-token\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.265724 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.265638    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7069d773-b7f5-4cf3-985b-4ae3f0740b62-registry-certificates\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.265724 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.265663    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7069d773-b7f5-4cf3-985b-4ae3f0740b62-registry-tls\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.266094 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.265735    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7069d773-b7f5-4cf3-985b-4ae3f0740b62-installation-pull-secrets\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.266094 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.265792    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8k8m\" (UniqueName: \"kubernetes.io/projected/7069d773-b7f5-4cf3-985b-4ae3f0740b62-kube-api-access-g8k8m\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.266094 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.265834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7069d773-b7f5-4cf3-985b-4ae3f0740b62-image-registry-private-configuration\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.266094 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.265863    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rncvl\" (UniqueName: \"kubernetes.io/projected/6af94df2-b119-4124-9b50-ec537eb46803-kube-api-access-rncvl\") pod \"managed-serviceaccount-addon-agent-5754c76c94-x5qg9\" (UID: \"6af94df2-b119-4124-9b50-ec537eb46803\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9"
Jul 24 18:41:29.266094 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.265953    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:29.266094 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.265961    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7069d773-b7f5-4cf3-985b-4ae3f0740b62-trusted-ca\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.360281 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.360193    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:29.367303 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.367266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7069d773-b7f5-4cf3-985b-4ae3f0740b62-registry-tls\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.367486 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.367310    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7069d773-b7f5-4cf3-985b-4ae3f0740b62-installation-pull-secrets\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.367486 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.367358    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8k8m\" (UniqueName: \"kubernetes.io/projected/7069d773-b7f5-4cf3-985b-4ae3f0740b62-kube-api-access-g8k8m\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.367486 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.367402    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7069d773-b7f5-4cf3-985b-4ae3f0740b62-image-registry-private-configuration\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.367486 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.367427    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rncvl\" (UniqueName: \"kubernetes.io/projected/6af94df2-b119-4124-9b50-ec537eb46803-kube-api-access-rncvl\") pod \"managed-serviceaccount-addon-agent-5754c76c94-x5qg9\" (UID: \"6af94df2-b119-4124-9b50-ec537eb46803\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9"
Jul 24 18:41:29.367486 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.367464    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7069d773-b7f5-4cf3-985b-4ae3f0740b62-trusted-ca\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.367740 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.367529    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6af94df2-b119-4124-9b50-ec537eb46803-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5754c76c94-x5qg9\" (UID: \"6af94df2-b119-4124-9b50-ec537eb46803\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9"
Jul 24 18:41:29.367740 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.367560    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7069d773-b7f5-4cf3-985b-4ae3f0740b62-ca-trust-extracted\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.367740 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.367593    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7069d773-b7f5-4cf3-985b-4ae3f0740b62-bound-sa-token\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.367740 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.367619    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7069d773-b7f5-4cf3-985b-4ae3f0740b62-registry-certificates\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.368713 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.368475    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7069d773-b7f5-4cf3-985b-4ae3f0740b62-registry-certificates\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.368713 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.368486    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7069d773-b7f5-4cf3-985b-4ae3f0740b62-ca-trust-extracted\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.368918 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.368748    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7069d773-b7f5-4cf3-985b-4ae3f0740b62-trusted-ca\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.370197 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.370171    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7069d773-b7f5-4cf3-985b-4ae3f0740b62-installation-pull-secrets\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.370493 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.370445    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7069d773-b7f5-4cf3-985b-4ae3f0740b62-registry-tls\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.371262 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.371238    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7069d773-b7f5-4cf3-985b-4ae3f0740b62-image-registry-private-configuration\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.371777 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.371746    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6af94df2-b119-4124-9b50-ec537eb46803-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5754c76c94-x5qg9\" (UID: \"6af94df2-b119-4124-9b50-ec537eb46803\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9"
Jul 24 18:41:29.378553 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.378130    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7069d773-b7f5-4cf3-985b-4ae3f0740b62-bound-sa-token\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.378553 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.378276    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8k8m\" (UniqueName: \"kubernetes.io/projected/7069d773-b7f5-4cf3-985b-4ae3f0740b62-kube-api-access-g8k8m\") pod \"image-registry-755b99fc9-p757p\" (UID: \"7069d773-b7f5-4cf3-985b-4ae3f0740b62\") " pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.382471 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.382449    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rncvl\" (UniqueName: \"kubernetes.io/projected/6af94df2-b119-4124-9b50-ec537eb46803-kube-api-access-rncvl\") pod \"managed-serviceaccount-addon-agent-5754c76c94-x5qg9\" (UID: \"6af94df2-b119-4124-9b50-ec537eb46803\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9"
Jul 24 18:41:29.469987 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.469954    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9"
Jul 24 18:41:29.531888 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.531850    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:29.807306 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:29.807270    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:30.436573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:30.436537    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:31.155018 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:31.154988    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nml7m" event={"ID":"6949c3ad-f467-45a2-8182-8c18079f4407","Type":"ContainerStarted","Data":"6790a4a6e7885fa1053f970bab91601a762e912579ed8f84b0676b162af72c7a"}
Jul 24 18:41:31.155882 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:31.155863    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9"]
Jul 24 18:41:31.158034 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:31.158004    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6af94df2_b119_4124_9b50_ec537eb46803.slice/crio-96273feda3a746059f72c33130e1ce96e959dc3932aac55d09a8d06eb19f5d82 WatchSource:0}: Error finding container 96273feda3a746059f72c33130e1ce96e959dc3932aac55d09a8d06eb19f5d82: Status 404 returned error can't find the container with id 96273feda3a746059f72c33130e1ce96e959dc3932aac55d09a8d06eb19f5d82
Jul 24 18:41:31.180394 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:31.180354    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-755b99fc9-p757p"]
Jul 24 18:41:31.183533 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:31.183508    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7069d773_b7f5_4cf3_985b_4ae3f0740b62.slice/crio-d8905622804abe887c59347e52510a68c26bea66e778398df0a32829c5548e73 WatchSource:0}: Error finding container d8905622804abe887c59347e52510a68c26bea66e778398df0a32829c5548e73: Status 404 returned error can't find the container with id d8905622804abe887c59347e52510a68c26bea66e778398df0a32829c5548e73
Jul 24 18:41:32.161297 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:32.161256    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9" event={"ID":"6af94df2-b119-4124-9b50-ec537eb46803","Type":"ContainerStarted","Data":"96273feda3a746059f72c33130e1ce96e959dc3932aac55d09a8d06eb19f5d82"}
Jul 24 18:41:32.163481 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:32.163358    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755b99fc9-p757p" event={"ID":"7069d773-b7f5-4cf3-985b-4ae3f0740b62","Type":"ContainerStarted","Data":"992efb64b75c2861abbf1ef5fdfc98d1acf66ce97fe95a30183b329a4964740b"}
Jul 24 18:41:32.163481 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:32.163427    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755b99fc9-p757p" event={"ID":"7069d773-b7f5-4cf3-985b-4ae3f0740b62","Type":"ContainerStarted","Data":"d8905622804abe887c59347e52510a68c26bea66e778398df0a32829c5548e73"}
Jul 24 18:41:32.163675 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:32.163655    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:32.185566 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:32.185506    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-755b99fc9-p757p" podStartSLOduration=3.185484821 podStartE2EDuration="3.185484821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:32.184677947 +0000 UTC m=+80.109630542" watchObservedRunningTime="2026-07-24 18:41:32.185484821 +0000 UTC m=+80.110437416"
Jul 24 18:41:32.692781 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:32.692748    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:32.748967 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:32.748911    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:32.897928 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:32.897888    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:32.900895 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:32.900843    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/765f62ba-a979-469f-ad0d-bd7d2efa79d1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-kdjz5\" (UID: \"765f62ba-a979-469f-ad0d-bd7d2efa79d1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:33.057972 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:33.057942    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8rw8g\""
Jul 24 18:41:33.066217 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:33.066186    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"
Jul 24 18:41:34.449918 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.449431    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:34.459728 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.459697    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59cdf6854d-28j5z"]
Jul 24 18:41:34.473574 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.473523    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cdf6854d-28j5z"]
Jul 24 18:41:34.473574 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.473557    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.476596 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.476401    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 18:41:34.476596 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.476551    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 18:41:34.477644 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.477413    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 18:41:34.477644 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.477464    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 18:41:34.477644 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.477548    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 18:41:34.477644 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.477424    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pfkj5\""
Jul 24 18:41:34.477925 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.477655    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 18:41:34.477976 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.477952    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 18:41:34.612577 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.612532    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-config\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.612577 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.612581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-serving-cert\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.612802 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.612605    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-oauth-serving-cert\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.612802 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.612647    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-oauth-config\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.612802 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.612684    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-service-ca\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.612802 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.612738    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxmpz\" (UniqueName: \"kubernetes.io/projected/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-kube-api-access-bxmpz\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.713681 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.713641    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-oauth-serving-cert\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.713847 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.713709    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-oauth-config\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.713847 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.713747    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-service-ca\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.713847 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.713781    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxmpz\" (UniqueName: \"kubernetes.io/projected/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-kube-api-access-bxmpz\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.714004 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.713847    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-config\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.714004 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.713881    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-serving-cert\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.714632 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.714483    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-oauth-serving-cert\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.714632 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.714519    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-service-ca\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.714632 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.714599    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-config\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.716521 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.716499    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-oauth-config\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.716632 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.716566    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-serving-cert\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.722502 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.722476    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxmpz\" (UniqueName: \"kubernetes.io/projected/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-kube-api-access-bxmpz\") pod \"console-59cdf6854d-28j5z\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") " pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:34.786689 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:34.786650    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:35.134163 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:35.134080    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fpk2x"
Jul 24 18:41:35.720077 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:35.720048    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cdf6854d-28j5z"]
Jul 24 18:41:35.724349 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:35.723186    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea865fbf_615d_4d3a_81f7_0b2ed381d33c.slice/crio-66155d1bab8a55fbc542e2fc7aa5514e80c68b0840d5bda3ae13b6ca169e5229 WatchSource:0}: Error finding container 66155d1bab8a55fbc542e2fc7aa5514e80c68b0840d5bda3ae13b6ca169e5229: Status 404 returned error can't find the container with id 66155d1bab8a55fbc542e2fc7aa5514e80c68b0840d5bda3ae13b6ca169e5229
Jul 24 18:41:35.736438 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:35.736408    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5"]
Jul 24 18:41:35.739965 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:35.739936    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod765f62ba_a979_469f_ad0d_bd7d2efa79d1.slice/crio-18d6938818cf3fbf58ea49ee1e0cac127431b6a6f87aa52064d2ad3f8370f1e6 WatchSource:0}: Error finding container 18d6938818cf3fbf58ea49ee1e0cac127431b6a6f87aa52064d2ad3f8370f1e6: Status 404 returned error can't find the container with id 18d6938818cf3fbf58ea49ee1e0cac127431b6a6f87aa52064d2ad3f8370f1e6
Jul 24 18:41:36.182235 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:36.182192    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nml7m" event={"ID":"6949c3ad-f467-45a2-8182-8c18079f4407","Type":"ContainerStarted","Data":"25ccb507ee17ef46df77c3ce3517bd627d7017de2ea67dd1b63be6032ea1a130"}
Jul 24 18:41:36.183748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:36.183718    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5" event={"ID":"765f62ba-a979-469f-ad0d-bd7d2efa79d1","Type":"ContainerStarted","Data":"18d6938818cf3fbf58ea49ee1e0cac127431b6a6f87aa52064d2ad3f8370f1e6"}
Jul 24 18:41:36.185000 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:36.184970    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cdf6854d-28j5z" event={"ID":"ea865fbf-615d-4d3a-81f7-0b2ed381d33c","Type":"ContainerStarted","Data":"66155d1bab8a55fbc542e2fc7aa5514e80c68b0840d5bda3ae13b6ca169e5229"}
Jul 24 18:41:36.186620 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:36.186593    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9" event={"ID":"6af94df2-b119-4124-9b50-ec537eb46803","Type":"ContainerStarted","Data":"affae5c3e30c17e6bd886ec40602b182421e990ba171b117f6e35946deaa121b"}
Jul 24 18:41:36.203753 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:36.203680    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nml7m" podStartSLOduration=18.373592449 podStartE2EDuration="31.203658204s" totalImagesPullingTime="12.830065755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:41:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:36.200863015 +0000 UTC m=+84.125815608" watchObservedRunningTime="2026-07-24 18:41:36.203658204 +0000 UTC m=+84.128610802"
Jul 24 18:41:36.223264 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:36.223201    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5754c76c94-x5qg9" podStartSLOduration=2.800080876 podStartE2EDuration="7.223182597s" totalImagesPullingTime="4.423101721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:36.222031619 +0000 UTC m=+84.146984217" watchObservedRunningTime="2026-07-24 18:41:36.223182597 +0000 UTC m=+84.148135190"
Jul 24 18:41:36.649458 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:36.649411    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:36.713416 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:36.713326    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:37.785939 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:37.785910    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:37.893233 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:37.893193    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:37.974703 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:37.974653    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:37.975164 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:37.975142    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n"]
Jul 24 18:41:37.978540 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:37.978513    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n"
Jul 24 18:41:37.981668 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:37.981453    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 24 18:41:37.981668 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:37.981648    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wzjmv\""
Jul 24 18:41:37.989884 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:37.989862    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n"]
Jul 24 18:41:38.043729 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:38.043630    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b6843463-8e5e-418b-9529-a97dca2a3ffd-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-b244n\" (UID: \"b6843463-8e5e-418b-9529-a97dca2a3ffd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n"
Jul 24 18:41:38.144854 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:38.144817    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b6843463-8e5e-418b-9529-a97dca2a3ffd-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-b244n\" (UID: \"b6843463-8e5e-418b-9529-a97dca2a3ffd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n"
Jul 24 18:41:38.145046 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:38.144987    2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 24 18:41:38.145105 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:41:38.145058    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6843463-8e5e-418b-9529-a97dca2a3ffd-tls-certificates podName:b6843463-8e5e-418b-9529-a97dca2a3ffd nodeName:}" failed. No retries permitted until 2026-07-24 18:41:38.645037614 +0000 UTC m=+86.569990192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/b6843463-8e5e-418b-9529-a97dca2a3ffd-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-b244n" (UID: "b6843463-8e5e-418b-9529-a97dca2a3ffd") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 24 18:41:38.197854 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:38.197809    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5" event={"ID":"765f62ba-a979-469f-ad0d-bd7d2efa79d1","Type":"ContainerStarted","Data":"e35f67d33300a02a4652c954e2e46dc6a448e92611e37567de4969807c459521"}
Jul 24 18:41:38.215313 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:38.215251    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-kdjz5" podStartSLOduration=36.512767188 podStartE2EDuration="38.215228735s" totalImagesPullingTime="1.702461547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:38.214052082 +0000 UTC m=+86.139004679" watchObservedRunningTime="2026-07-24 18:41:38.215228735 +0000 UTC m=+86.140181327"
Jul 24 18:41:38.399350 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:38.399260    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:38.649044 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:38.649005    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b6843463-8e5e-418b-9529-a97dca2a3ffd-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-b244n\" (UID: \"b6843463-8e5e-418b-9529-a97dca2a3ffd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n"
Jul 24 18:41:38.652084 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:38.652002    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b6843463-8e5e-418b-9529-a97dca2a3ffd-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-b244n\" (UID: \"b6843463-8e5e-418b-9529-a97dca2a3ffd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n"
Jul 24 18:41:38.889876 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:38.889835    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n"
Jul 24 18:41:39.036917 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:39.036878    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:39.096124 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:39.096090    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:39.115235 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:39.115203    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n"]
Jul 24 18:41:39.118822 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:39.118792    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6843463_8e5e_418b_9529_a97dca2a3ffd.slice/crio-f6029416edd80cdd8dbaba2046c23c55f3a85e0aa5f065e7275bd7448911888f WatchSource:0}: Error finding container f6029416edd80cdd8dbaba2046c23c55f3a85e0aa5f065e7275bd7448911888f: Status 404 returned error can't find the container with id f6029416edd80cdd8dbaba2046c23c55f3a85e0aa5f065e7275bd7448911888f
Jul 24 18:41:39.202995 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:39.202897    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n" event={"ID":"b6843463-8e5e-418b-9529-a97dca2a3ffd","Type":"ContainerStarted","Data":"f6029416edd80cdd8dbaba2046c23c55f3a85e0aa5f065e7275bd7448911888f"}
Jul 24 18:41:39.204359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:39.204321    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cdf6854d-28j5z" event={"ID":"ea865fbf-615d-4d3a-81f7-0b2ed381d33c","Type":"ContainerStarted","Data":"ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d"}
Jul 24 18:41:39.222573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:39.222510    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59cdf6854d-28j5z" podStartSLOduration=1.924827992 podStartE2EDuration="5.222491653s" totalImagesPullingTime="3.297663661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:39.22097266 +0000 UTC m=+87.145925258" watchObservedRunningTime="2026-07-24 18:41:39.222491653 +0000 UTC m=+87.147444246"
Jul 24 18:41:39.973629 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:39.973589    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:40.028929 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:40.028896    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:41.213134 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.213093    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n" event={"ID":"b6843463-8e5e-418b-9529-a97dca2a3ffd","Type":"ContainerStarted","Data":"dbf6a4a181bc869af7e8740e801401688724fc8a9dbf4cae0a7b86c5ec989f7b"}
Jul 24 18:41:41.213599 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.213334    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n"
Jul 24 18:41:41.217770 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.217748    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n"
Jul 24 18:41:41.229622 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.229578    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b244n" podStartSLOduration=3.071664939 podStartE2EDuration="4.229563657s" totalImagesPullingTime="1.157898718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:41.228303066 +0000 UTC m=+89.153255661" watchObservedRunningTime="2026-07-24 18:41:41.229563657 +0000 UTC m=+89.154516289"
Jul 24 18:41:41.450425 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.450392    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d4579b557-7h8qt"]
Jul 24 18:41:41.452413 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.452396    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.457411 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.457367    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:41.464467 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.464405    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 18:41:41.465792 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.465771    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d4579b557-7h8qt"]
Jul 24 18:41:41.523513 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.523463    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:41.572951 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.572923    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7w9q\" (UniqueName: \"kubernetes.io/projected/d4602b25-51b4-47a3-88af-78a600cc94d9-kube-api-access-k7w9q\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.573117 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.572958    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-console-config\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.573117 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.572981    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4602b25-51b4-47a3-88af-78a600cc94d9-console-oauth-config\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.573117 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.573001    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4602b25-51b4-47a3-88af-78a600cc94d9-console-serving-cert\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.573117 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.573088    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-service-ca\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.573249 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.573125    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-oauth-serving-cert\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.573249 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.573150    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-trusted-ca-bundle\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.673795 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.673754    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7w9q\" (UniqueName: \"kubernetes.io/projected/d4602b25-51b4-47a3-88af-78a600cc94d9-kube-api-access-k7w9q\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.673795 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.673800    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-console-config\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.673989 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.673821    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4602b25-51b4-47a3-88af-78a600cc94d9-console-oauth-config\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.673989 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.673839    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4602b25-51b4-47a3-88af-78a600cc94d9-console-serving-cert\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.673989 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.673967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-service-ca\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.674125 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.674022    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-oauth-serving-cert\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.674125 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.674059    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-trusted-ca-bundle\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.674687 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.674657    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-console-config\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.674687 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.674685    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-oauth-serving-cert\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.674843 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.674657    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-service-ca\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.675289 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.675264    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-trusted-ca-bundle\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.676305 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.676286    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4602b25-51b4-47a3-88af-78a600cc94d9-console-oauth-config\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.676502 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.676486    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4602b25-51b4-47a3-88af-78a600cc94d9-console-serving-cert\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.682422 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.682395    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7w9q\" (UniqueName: \"kubernetes.io/projected/d4602b25-51b4-47a3-88af-78a600cc94d9-kube-api-access-k7w9q\") pod \"console-7d4579b557-7h8qt\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") " pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.761617 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.761534    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:41.893030 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:41.893006    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d4579b557-7h8qt"]
Jul 24 18:41:41.895353 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:41.895323    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4602b25_51b4_47a3_88af_78a600cc94d9.slice/crio-faa4c9835e4124fcc81d324036a3e93fa25e14a1b936d2e9436079bf4488bc75 WatchSource:0}: Error finding container faa4c9835e4124fcc81d324036a3e93fa25e14a1b936d2e9436079bf4488bc75: Status 404 returned error can't find the container with id faa4c9835e4124fcc81d324036a3e93fa25e14a1b936d2e9436079bf4488bc75
Jul 24 18:41:42.008226 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:42.008186    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:42.081751 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:42.081600    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:42.217932 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:42.217892    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4579b557-7h8qt" event={"ID":"d4602b25-51b4-47a3-88af-78a600cc94d9","Type":"ContainerStarted","Data":"bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb"}
Jul 24 18:41:42.218419 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:42.217954    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4579b557-7h8qt" event={"ID":"d4602b25-51b4-47a3-88af-78a600cc94d9","Type":"ContainerStarted","Data":"faa4c9835e4124fcc81d324036a3e93fa25e14a1b936d2e9436079bf4488bc75"}
Jul 24 18:41:42.225549 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:42.225515    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:42.238506 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:42.238459    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d4579b557-7h8qt" podStartSLOduration=1.238445382 podStartE2EDuration="1.238445382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:42.237187303 +0000 UTC m=+90.162139908" watchObservedRunningTime="2026-07-24 18:41:42.238445382 +0000 UTC m=+90.163398029"
Jul 24 18:41:42.661892 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:42.661851    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:42.717595 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:42.717551    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:42.788008 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:42.787965    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:42.846225 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:42.846195    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:44.787722 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:44.787678    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:44.788192 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:44.787744    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:44.792679 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:44.792658    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:45.231415 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:45.231367    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:41:46.853949 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:46.853916    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:48.128713 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:48.128664    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:48.229998 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:48.229917    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:48.991349 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:48.991304    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:49.092563 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:49.092521    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:51.452724 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:51.452645    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:51.761808 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:51.761778    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:51.761997 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:51.761826    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:51.766850 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:51.766828    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:51.870331 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:51.870291    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:51.975490 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:51.975450    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:52.256455 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:52.256428    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:41:52.323167 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:52.323122    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cdf6854d-28j5z"]
Jul 24 18:41:53.159405 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.159360    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:53.173211 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.173183    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-755b99fc9-p757p"
Jul 24 18:41:53.244959 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.244928    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:53.333095 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.333050    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:53.437289 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.437189    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:53.461866 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.461827    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4lfv2"]
Jul 24 18:41:53.466195 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.466172    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.468499 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.468475    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 18:41:53.468802 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.468783    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 18:41:53.469039 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.469025    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 18:41:53.469096 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.469033    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 18:41:53.469477 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.469461    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2wdjq\""
Jul 24 18:41:53.523160 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.523117    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:53.577765 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.577724    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-tls\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.577951 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.577784    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-textfile\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.577951 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.577815    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw2nz\" (UniqueName: \"kubernetes.io/projected/1a87619b-d15f-4290-9485-7cac016374e2-kube-api-access-vw2nz\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.577951 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.577841    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a87619b-d15f-4290-9485-7cac016374e2-metrics-client-ca\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.578113 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.577950    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-wtmp\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.578113 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.577991    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a87619b-d15f-4290-9485-7cac016374e2-sys\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.578113 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.578052    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a87619b-d15f-4290-9485-7cac016374e2-root\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.578113 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.578097    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.578300 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.578128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.623840 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.623804    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:53.679437 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.679400    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a87619b-d15f-4290-9485-7cac016374e2-sys\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.679619 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.679458    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a87619b-d15f-4290-9485-7cac016374e2-root\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.679619 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.679513    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a87619b-d15f-4290-9485-7cac016374e2-sys\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.679619 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.679529    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a87619b-d15f-4290-9485-7cac016374e2-root\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.679619 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.679516    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.679825 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.679669    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.679825 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.679722    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-tls\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.679825 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.679761    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-textfile\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.679825 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.679787    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw2nz\" (UniqueName: \"kubernetes.io/projected/1a87619b-d15f-4290-9485-7cac016374e2-kube-api-access-vw2nz\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.679825 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.679814    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a87619b-d15f-4290-9485-7cac016374e2-metrics-client-ca\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.680065 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.679860    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-wtmp\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.680065 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.680024    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-wtmp\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.680292 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.680267    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.680598 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.680576    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a87619b-d15f-4290-9485-7cac016374e2-metrics-client-ca\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.680750 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.680604    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-textfile\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.682534 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.682481    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.682667 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.682643    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a87619b-d15f-4290-9485-7cac016374e2-node-exporter-tls\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.688196 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.688134    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw2nz\" (UniqueName: \"kubernetes.io/projected/1a87619b-d15f-4290-9485-7cac016374e2-kube-api-access-vw2nz\") pod \"node-exporter-4lfv2\" (UID: \"1a87619b-d15f-4290-9485-7cac016374e2\") " pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.723960 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.723915    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:53.775995 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.775946    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:53.777829 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.777810    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4lfv2"
Jul 24 18:41:53.790146 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:53.790113    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a87619b_d15f_4290_9485_7cac016374e2.slice/crio-5b11cd902d8cb524a81ce1e90c8c7e4aede85e802de67fe1407ed8eba6e292dc WatchSource:0}: Error finding container 5b11cd902d8cb524a81ce1e90c8c7e4aede85e802de67fe1407ed8eba6e292dc: Status 404 returned error can't find the container with id 5b11cd902d8cb524a81ce1e90c8c7e4aede85e802de67fe1407ed8eba6e292dc
Jul 24 18:41:53.849230 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.849190    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:53.949603 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:53.949504    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:54.049399 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:54.049329    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:54.118874 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:54.118846    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nqrpk"
Jul 24 18:41:54.265712 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:54.265675    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4lfv2" event={"ID":"1a87619b-d15f-4290-9485-7cac016374e2","Type":"ContainerStarted","Data":"5b11cd902d8cb524a81ce1e90c8c7e4aede85e802de67fe1407ed8eba6e292dc"}
Jul 24 18:41:54.439674 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:54.439629    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:54.500681 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:54.500638    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:54.589636 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:54.589550    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:55.271518 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:55.271482    2557 generic.go:356] "Generic (PLEG): container finished" podID="1a87619b-d15f-4290-9485-7cac016374e2" containerID="77520e1406714e64f68d4e650d369c257baa5bdca0c0350b9319db7a1815ccb6" exitCode=0
Jul 24 18:41:55.271928 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:55.271566    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4lfv2" event={"ID":"1a87619b-d15f-4290-9485-7cac016374e2","Type":"ContainerDied","Data":"77520e1406714e64f68d4e650d369c257baa5bdca0c0350b9319db7a1815ccb6"}
Jul 24 18:41:56.278083 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:56.278043    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4lfv2" event={"ID":"1a87619b-d15f-4290-9485-7cac016374e2","Type":"ContainerStarted","Data":"c8932540ce31d9ef2bb549b170d847527031a1cb5f3e0b998cd0c0c17270dd3e"}
Jul 24 18:41:56.278520 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:56.278106    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4lfv2" event={"ID":"1a87619b-d15f-4290-9485-7cac016374e2","Type":"ContainerStarted","Data":"71da6e8354d0e8190b1bc697b5893703106102bf1a2f738560702f5e61cd6913"}
Jul 24 18:41:56.297488 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:56.297423    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4lfv2" podStartSLOduration=2.337165715 podStartE2EDuration="3.297406799s" totalImagesPullingTime="892.704637ms" totalInitContainerRuntime="67.536447ms" isStatefulPod=true podCreationTimestamp="2026-07-24 18:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:56.297103826 +0000 UTC m=+104.222056419" watchObservedRunningTime="2026-07-24 18:41:56.297406799 +0000 UTC m=+104.222359371"
Jul 24 18:41:56.369746 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:56.369709    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:56.474783 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:56.474727    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:56.570342 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:56.570260    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:56.673902 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:56.673869    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:58.216869 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.216835    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:58.249357 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.249324    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"]
Jul 24 18:41:58.304284 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.304249    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"]
Jul 24 18:41:58.304466 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.304348    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"
Jul 24 18:41:58.307047 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.307019    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 24 18:41:58.307198 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.307022    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xn92k\""
Jul 24 18:41:58.308390 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.308350    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:58.411997 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.411967    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:58.418274 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.418246    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8kq6\" (UniqueName: \"kubernetes.io/projected/461ee2ae-7831-4b75-92a3-5574435242ba-kube-api-access-m8kq6\") pod \"monitoring-plugin-68b7fc9574-4rwvx\" (UID: \"461ee2ae-7831-4b75-92a3-5574435242ba\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"
Jul 24 18:41:58.418417 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.418392    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/461ee2ae-7831-4b75-92a3-5574435242ba-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4rwvx\" (UID: \"461ee2ae-7831-4b75-92a3-5574435242ba\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"
Jul 24 18:41:58.519507 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.519408    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/461ee2ae-7831-4b75-92a3-5574435242ba-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4rwvx\" (UID: \"461ee2ae-7831-4b75-92a3-5574435242ba\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"
Jul 24 18:41:58.519507 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.519488    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8kq6\" (UniqueName: \"kubernetes.io/projected/461ee2ae-7831-4b75-92a3-5574435242ba-kube-api-access-m8kq6\") pod \"monitoring-plugin-68b7fc9574-4rwvx\" (UID: \"461ee2ae-7831-4b75-92a3-5574435242ba\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"
Jul 24 18:41:58.524148 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.522977    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/461ee2ae-7831-4b75-92a3-5574435242ba-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4rwvx\" (UID: \"461ee2ae-7831-4b75-92a3-5574435242ba\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"
Jul 24 18:41:58.529227 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.529196    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8kq6\" (UniqueName: \"kubernetes.io/projected/461ee2ae-7831-4b75-92a3-5574435242ba-kube-api-access-m8kq6\") pod \"monitoring-plugin-68b7fc9574-4rwvx\" (UID: \"461ee2ae-7831-4b75-92a3-5574435242ba\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"
Jul 24 18:41:58.615052 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.615016    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"
Jul 24 18:41:58.766047 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:58.766022    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"]
Jul 24 18:41:58.768493 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:58.768462    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461ee2ae_7831_4b75_92a3_5574435242ba.slice/crio-be158e5f25ea79c62af58ccd242bd982e3eae2016a796e801487b8605e0979fb WatchSource:0}: Error finding container be158e5f25ea79c62af58ccd242bd982e3eae2016a796e801487b8605e0979fb: Status 404 returned error can't find the container with id be158e5f25ea79c62af58ccd242bd982e3eae2016a796e801487b8605e0979fb
Jul 24 18:41:59.251710 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.251671    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:59.261365 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.261333    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-568cd6f6bb-lrw57"]
Jul 24 18:41:59.292904 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.292867    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx" event={"ID":"461ee2ae-7831-4b75-92a3-5574435242ba","Type":"ContainerStarted","Data":"be158e5f25ea79c62af58ccd242bd982e3eae2016a796e801487b8605e0979fb"}
Jul 24 18:41:59.293076 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.292911    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568cd6f6bb-lrw57"]
Jul 24 18:41:59.293076 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.292989    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.315751 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.315711    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:59.427886 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.427836    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-trusted-ca-bundle\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.427886 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.427890    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-console-config\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.428105 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.427913    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-service-ca\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.428105 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.427989    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-oauth-serving-cert\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.428105 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.428039    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/010f395f-880c-4b8b-b99f-26c9bec5b019-console-oauth-config\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.428105 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.428064    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/010f395f-880c-4b8b-b99f-26c9bec5b019-console-serving-cert\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.428242 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.428112    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl7zn\" (UniqueName: \"kubernetes.io/projected/010f395f-880c-4b8b-b99f-26c9bec5b019-kube-api-access-fl7zn\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.528775 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.528671    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-console-config\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.528775 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.528716    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-service-ca\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.528775 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.528774    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-oauth-serving-cert\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.529073 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.528811    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/010f395f-880c-4b8b-b99f-26c9bec5b019-console-oauth-config\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.529073 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.528838    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/010f395f-880c-4b8b-b99f-26c9bec5b019-console-serving-cert\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.529073 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.528892    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl7zn\" (UniqueName: \"kubernetes.io/projected/010f395f-880c-4b8b-b99f-26c9bec5b019-kube-api-access-fl7zn\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.529073 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.528983    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-trusted-ca-bundle\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.529509 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.529486    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-console-config\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.529604 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.529559    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-oauth-serving-cert\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.529604 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.529559    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-service-ca\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.529930 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.529908    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-trusted-ca-bundle\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.531536 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.531511    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/010f395f-880c-4b8b-b99f-26c9bec5b019-console-oauth-config\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.531601 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.531589    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/010f395f-880c-4b8b-b99f-26c9bec5b019-console-serving-cert\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.540741 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.540712    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl7zn\" (UniqueName: \"kubernetes.io/projected/010f395f-880c-4b8b-b99f-26c9bec5b019-kube-api-access-fl7zn\") pod \"console-568cd6f6bb-lrw57\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") " pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.602569 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.602531    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:41:59.642343 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.642314    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:41:59.767394 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:41:59.767345    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568cd6f6bb-lrw57"]
Jul 24 18:41:59.770579 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:41:59.770550    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010f395f_880c_4b8b_b99f_26c9bec5b019.slice/crio-a18a58a3f66e12e7f661835d236dfeede50c3e7217b891d4ee77b2e6bbeed179 WatchSource:0}: Error finding container a18a58a3f66e12e7f661835d236dfeede50c3e7217b891d4ee77b2e6bbeed179: Status 404 returned error can't find the container with id a18a58a3f66e12e7f661835d236dfeede50c3e7217b891d4ee77b2e6bbeed179
Jul 24 18:42:00.296603 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:00.296568    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568cd6f6bb-lrw57" event={"ID":"010f395f-880c-4b8b-b99f-26c9bec5b019","Type":"ContainerStarted","Data":"d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2"}
Jul 24 18:42:00.297088 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:00.296624    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568cd6f6bb-lrw57" event={"ID":"010f395f-880c-4b8b-b99f-26c9bec5b019","Type":"ContainerStarted","Data":"a18a58a3f66e12e7f661835d236dfeede50c3e7217b891d4ee77b2e6bbeed179"}
Jul 24 18:42:00.316669 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:00.316609    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-568cd6f6bb-lrw57" podStartSLOduration=1.316588146 podStartE2EDuration="1.316588146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:42:00.313855765 +0000 UTC m=+108.238808360" watchObservedRunningTime="2026-07-24 18:42:00.316588146 +0000 UTC m=+108.241540741"
Jul 24 18:42:00.318532 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:00.318497    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:00.372014 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:00.371976    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:01.301661 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:01.301627    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx" event={"ID":"461ee2ae-7831-4b75-92a3-5574435242ba","Type":"ContainerStarted","Data":"826d2ea815867fcaa86c96d17b2dcaab40bd1762cb9fd4dafb3ddaa594b744a5"}
Jul 24 18:42:01.302058 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:01.301809    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"
Jul 24 18:42:01.306635 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:01.306612    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx"
Jul 24 18:42:01.318084 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:01.318032    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4rwvx" podStartSLOduration=1.144584727 podStartE2EDuration="3.318016999s" totalImagesPullingTime="2.173432272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:42:01.316863788 +0000 UTC m=+109.241816382" watchObservedRunningTime="2026-07-24 18:42:01.318016999 +0000 UTC m=+109.242969592"
Jul 24 18:42:03.557439 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.557398    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568cd6f6bb-lrw57"]
Jul 24 18:42:03.621326 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.621285    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6956bc5d94-jkd4z"]
Jul 24 18:42:03.664933 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.664899    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6956bc5d94-jkd4z"]
Jul 24 18:42:03.665077 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.664996    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.762223 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.762187    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-service-ca\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.762223 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.762228    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-trusted-ca-bundle\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.762473 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.762276    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-oauth-config\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.762473 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.762311    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-serving-cert\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.762473 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.762346    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbt2w\" (UniqueName: \"kubernetes.io/projected/09915647-88a7-4ddc-b78d-2fd99ae2c55f-kube-api-access-hbt2w\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.762473 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.762421    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-config\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.762473 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.762446    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-oauth-serving-cert\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.863098 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.863018    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-oauth-serving-cert\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.863098 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.863078    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-service-ca\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.863098 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.863099    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-trusted-ca-bundle\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.863367 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.863126    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-oauth-config\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.863367 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.863141    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-serving-cert\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.863367 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.863155    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbt2w\" (UniqueName: \"kubernetes.io/projected/09915647-88a7-4ddc-b78d-2fd99ae2c55f-kube-api-access-hbt2w\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.863367 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.863176    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-config\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.863872 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.863828    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-config\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.863959 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.863828    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-oauth-serving-cert\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.863997 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.863959    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-service-ca\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.864300 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.864277    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-trusted-ca-bundle\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.865581 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.865562    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-oauth-config\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.866039 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.866023    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-serving-cert\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.871663 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.871632    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbt2w\" (UniqueName: \"kubernetes.io/projected/09915647-88a7-4ddc-b78d-2fd99ae2c55f-kube-api-access-hbt2w\") pod \"console-6956bc5d94-jkd4z\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") " pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:03.973947 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:03.973907    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:04.049265 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:04.049227    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:04.151027 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:04.150952    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6956bc5d94-jkd4z"]
Jul 24 18:42:04.151222 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:04.151202    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:04.154356 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:42:04.154332    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09915647_88a7_4ddc_b78d_2fd99ae2c55f.slice/crio-9eb69267b0b3ee7dd5db7bb7ccd9ef954467ae963de1025796ed8a370f36333a WatchSource:0}: Error finding container 9eb69267b0b3ee7dd5db7bb7ccd9ef954467ae963de1025796ed8a370f36333a: Status 404 returned error can't find the container with id 9eb69267b0b3ee7dd5db7bb7ccd9ef954467ae963de1025796ed8a370f36333a
Jul 24 18:42:04.316602 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:04.316567    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6956bc5d94-jkd4z" event={"ID":"09915647-88a7-4ddc-b78d-2fd99ae2c55f","Type":"ContainerStarted","Data":"47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d"}
Jul 24 18:42:04.316781 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:04.316626    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6956bc5d94-jkd4z" event={"ID":"09915647-88a7-4ddc-b78d-2fd99ae2c55f","Type":"ContainerStarted","Data":"9eb69267b0b3ee7dd5db7bb7ccd9ef954467ae963de1025796ed8a370f36333a"}
Jul 24 18:42:04.336270 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:04.336216    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6956bc5d94-jkd4z" podStartSLOduration=1.336197955 podStartE2EDuration="1.336197955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:42:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:42:04.33587643 +0000 UTC m=+112.260829024" watchObservedRunningTime="2026-07-24 18:42:04.336197955 +0000 UTC m=+112.261150550"
Jul 24 18:42:09.603193 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:09.603158    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:42:09.784081 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:09.784050    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:09.850626 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:09.850592    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:11.342503 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:11.342471    2557 generic.go:356] "Generic (PLEG): container finished" podID="4564a69c-d148-4cd9-8189-b6f6099ce3fc" containerID="0c1a2358b86a393e1cb9654bc38723daba91b34e307209539678fa9cfa34ca70" exitCode=0
Jul 24 18:42:11.343008 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:11.342529    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7" event={"ID":"4564a69c-d148-4cd9-8189-b6f6099ce3fc","Type":"ContainerDied","Data":"0c1a2358b86a393e1cb9654bc38723daba91b34e307209539678fa9cfa34ca70"}
Jul 24 18:42:11.343008 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:11.342979    2557 scope.go:117] "RemoveContainer" containerID="0c1a2358b86a393e1cb9654bc38723daba91b34e307209539678fa9cfa34ca70"
Jul 24 18:42:12.348079 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:12.348040    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tnfz7" event={"ID":"4564a69c-d148-4cd9-8189-b6f6099ce3fc","Type":"ContainerStarted","Data":"0011f274301eb53d91263eefa8c8b3435fc4b3cfe51ad305ef67958fac933c1a"}
Jul 24 18:42:12.770850 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:12.770817    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:12.871511 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:12.871468    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:13.906790 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:13.906751    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:13.974099 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:13.974065    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:13.974284 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:13.974149    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:13.979238 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:13.979211    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:14.007341 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:14.007311    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:14.359993 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:14.359961    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:42:14.408003 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:14.407975    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d4579b557-7h8qt"]
Jul 24 18:42:14.516704 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:14.516672    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:14.571646 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:14.571610    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:14.639661 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:14.639573    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:17.342645 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.342577    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59cdf6854d-28j5z" podUID="ea865fbf-615d-4d3a-81f7-0b2ed381d33c" containerName="console" containerID="cri-o://ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d" gracePeriod=15
Jul 24 18:42:17.587328 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.587303    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:42:17.682709 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.682606    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-serving-cert\") pod \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") "
Jul 24 18:42:17.682709 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.682648    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-service-ca\") pod \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") "
Jul 24 18:42:17.682709 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.682670    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-config\") pod \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") "
Jul 24 18:42:17.682709 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.682691    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-oauth-config\") pod \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") "
Jul 24 18:42:17.683047 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.682887    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-oauth-serving-cert\") pod \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") "
Jul 24 18:42:17.683047 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.682952    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxmpz\" (UniqueName: \"kubernetes.io/projected/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-kube-api-access-bxmpz\") pod \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\" (UID: \"ea865fbf-615d-4d3a-81f7-0b2ed381d33c\") "
Jul 24 18:42:17.683181 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.683075    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-service-ca" (OuterVolumeSpecName: "service-ca") pod "ea865fbf-615d-4d3a-81f7-0b2ed381d33c" (UID: "ea865fbf-615d-4d3a-81f7-0b2ed381d33c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:42:17.683300 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.683069    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-config" (OuterVolumeSpecName: "console-config") pod "ea865fbf-615d-4d3a-81f7-0b2ed381d33c" (UID: "ea865fbf-615d-4d3a-81f7-0b2ed381d33c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:42:17.683678 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.683597    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ea865fbf-615d-4d3a-81f7-0b2ed381d33c" (UID: "ea865fbf-615d-4d3a-81f7-0b2ed381d33c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:42:17.683790 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.683755    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:17.685558 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.685522    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-kube-api-access-bxmpz" (OuterVolumeSpecName: "kube-api-access-bxmpz") pod "ea865fbf-615d-4d3a-81f7-0b2ed381d33c" (UID: "ea865fbf-615d-4d3a-81f7-0b2ed381d33c"). InnerVolumeSpecName "kube-api-access-bxmpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:42:17.685558 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.685537    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ea865fbf-615d-4d3a-81f7-0b2ed381d33c" (UID: "ea865fbf-615d-4d3a-81f7-0b2ed381d33c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:42:17.685730 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.685541    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ea865fbf-615d-4d3a-81f7-0b2ed381d33c" (UID: "ea865fbf-615d-4d3a-81f7-0b2ed381d33c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:42:17.784664 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.784625    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-serving-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:17.784664 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.784658    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-config\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:17.784664 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.784668    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-console-oauth-config\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:17.784664 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.784677    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-oauth-serving-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:17.784923 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:17.784686    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxmpz\" (UniqueName: \"kubernetes.io/projected/ea865fbf-615d-4d3a-81f7-0b2ed381d33c-kube-api-access-bxmpz\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:18.372598 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:18.372565    2557 generic.go:356] "Generic (PLEG): container finished" podID="ea865fbf-615d-4d3a-81f7-0b2ed381d33c" containerID="ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d" exitCode=0
Jul 24 18:42:18.372991 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:18.372627    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cdf6854d-28j5z"
Jul 24 18:42:18.372991 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:18.372649    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cdf6854d-28j5z" event={"ID":"ea865fbf-615d-4d3a-81f7-0b2ed381d33c","Type":"ContainerDied","Data":"ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d"}
Jul 24 18:42:18.372991 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:18.372732    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cdf6854d-28j5z" event={"ID":"ea865fbf-615d-4d3a-81f7-0b2ed381d33c","Type":"ContainerDied","Data":"66155d1bab8a55fbc542e2fc7aa5514e80c68b0840d5bda3ae13b6ca169e5229"}
Jul 24 18:42:18.373596 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:18.373579    2557 scope.go:117] "RemoveContainer" containerID="ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d"
Jul 24 18:42:18.382288 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:18.382266    2557 scope.go:117] "RemoveContainer" containerID="ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d"
Jul 24 18:42:18.382587 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:42:18.382566    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d\": container with ID starting with ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d not found: ID does not exist" containerID="ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d"
Jul 24 18:42:18.382662 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:18.382595    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d"} err="failed to get container status \"ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d\": rpc error: code = NotFound desc = could not find container \"ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d\": container with ID starting with ee36efa7958b039e7b969abdb5089a5c679a45f0d23a02c800216d4fe3c4968d not found: ID does not exist"
Jul 24 18:42:18.393930 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:18.393897    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cdf6854d-28j5z"]
Jul 24 18:42:18.397722 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:18.397696    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59cdf6854d-28j5z"]
Jul 24 18:42:18.620488 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:18.620453    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea865fbf-615d-4d3a-81f7-0b2ed381d33c" path="/var/lib/kubelet/pods/ea865fbf-615d-4d3a-81f7-0b2ed381d33c/volumes"
Jul 24 18:42:19.048253 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:19.048219    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:19.143396 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:19.143344    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:20.215118 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:20.215089    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:20.282333 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:20.282299    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:21.313489 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:21.313453    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:42:21.315758 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:21.315726    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/251138c6-eb4c-4212-963c-dc993e074afc-metrics-certs\") pod \"network-metrics-daemon-slqg5\" (UID: \"251138c6-eb4c-4212-963c-dc993e074afc\") " pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:42:21.440453 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:21.440425    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f8czh\""
Jul 24 18:42:21.448362 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:21.448338    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slqg5"
Jul 24 18:42:21.575045 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:21.574967    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-slqg5"]
Jul 24 18:42:21.578985 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:42:21.578955    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251138c6_eb4c_4212_963c_dc993e074afc.slice/crio-a452c35e928e4c4a313dffe0d16ff2e35ac50f8ee9cf8d0d2efc7cd1603e1c7a WatchSource:0}: Error finding container a452c35e928e4c4a313dffe0d16ff2e35ac50f8ee9cf8d0d2efc7cd1603e1c7a: Status 404 returned error can't find the container with id a452c35e928e4c4a313dffe0d16ff2e35ac50f8ee9cf8d0d2efc7cd1603e1c7a
Jul 24 18:42:22.391471 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:22.391428    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-slqg5" event={"ID":"251138c6-eb4c-4212-963c-dc993e074afc","Type":"ContainerStarted","Data":"a452c35e928e4c4a313dffe0d16ff2e35ac50f8ee9cf8d0d2efc7cd1603e1c7a"}
Jul 24 18:42:23.396704 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:23.396660    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-slqg5" event={"ID":"251138c6-eb4c-4212-963c-dc993e074afc","Type":"ContainerStarted","Data":"2607c3c350c3c559cf687822c9cbc66cb819cad7c041ec0242a8c5cf3d4350cb"}
Jul 24 18:42:23.397106 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:23.396721    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-slqg5" event={"ID":"251138c6-eb4c-4212-963c-dc993e074afc","Type":"ContainerStarted","Data":"e8c48b3e2c7b4e5b040c0e588e383a2e40fe3649e7e382a2c5c83419d574e0db"}
Jul 24 18:42:23.414102 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:23.414047    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-slqg5" podStartSLOduration=130.546058559 podStartE2EDuration="2m11.414032194s" totalImagesPullingTime="867.973635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:42:23.412989587 +0000 UTC m=+131.337942182" watchObservedRunningTime="2026-07-24 18:42:23.414032194 +0000 UTC m=+131.338984788"
Jul 24 18:42:23.496487 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:23.496423    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:23.571541 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:23.571511    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:42:28.576352 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.576309    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-568cd6f6bb-lrw57" podUID="010f395f-880c-4b8b-b99f-26c9bec5b019" containerName="console" containerID="cri-o://d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2" gracePeriod=15
Jul 24 18:42:28.824948 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.824923    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:42:28.880863 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.880775    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-trusted-ca-bundle\") pod \"010f395f-880c-4b8b-b99f-26c9bec5b019\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") "
Jul 24 18:42:28.880863 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.880836    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-service-ca\") pod \"010f395f-880c-4b8b-b99f-26c9bec5b019\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") "
Jul 24 18:42:28.881050 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.880878    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-oauth-serving-cert\") pod \"010f395f-880c-4b8b-b99f-26c9bec5b019\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") "
Jul 24 18:42:28.881090 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.881060    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/010f395f-880c-4b8b-b99f-26c9bec5b019-console-serving-cert\") pod \"010f395f-880c-4b8b-b99f-26c9bec5b019\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") "
Jul 24 18:42:28.881145 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.881115    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/010f395f-880c-4b8b-b99f-26c9bec5b019-console-oauth-config\") pod \"010f395f-880c-4b8b-b99f-26c9bec5b019\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") "
Jul 24 18:42:28.881207 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.881149    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-console-config\") pod \"010f395f-880c-4b8b-b99f-26c9bec5b019\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") "
Jul 24 18:42:28.881207 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.881185    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl7zn\" (UniqueName: \"kubernetes.io/projected/010f395f-880c-4b8b-b99f-26c9bec5b019-kube-api-access-fl7zn\") pod \"010f395f-880c-4b8b-b99f-26c9bec5b019\" (UID: \"010f395f-880c-4b8b-b99f-26c9bec5b019\") "
Jul 24 18:42:28.881309 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.881257    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "010f395f-880c-4b8b-b99f-26c9bec5b019" (UID: "010f395f-880c-4b8b-b99f-26c9bec5b019"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:42:28.881309 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.881274    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-service-ca" (OuterVolumeSpecName: "service-ca") pod "010f395f-880c-4b8b-b99f-26c9bec5b019" (UID: "010f395f-880c-4b8b-b99f-26c9bec5b019"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:42:28.881490 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.881350    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "010f395f-880c-4b8b-b99f-26c9bec5b019" (UID: "010f395f-880c-4b8b-b99f-26c9bec5b019"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:42:28.881573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.881550    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-console-config" (OuterVolumeSpecName: "console-config") pod "010f395f-880c-4b8b-b99f-26c9bec5b019" (UID: "010f395f-880c-4b8b-b99f-26c9bec5b019"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:42:28.881650 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.881632    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-trusted-ca-bundle\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:28.881688 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.881653    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:28.881688 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.881663    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-oauth-serving-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:28.881688 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.881671    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/010f395f-880c-4b8b-b99f-26c9bec5b019-console-config\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:28.883233 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.883207    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/010f395f-880c-4b8b-b99f-26c9bec5b019-kube-api-access-fl7zn" (OuterVolumeSpecName: "kube-api-access-fl7zn") pod "010f395f-880c-4b8b-b99f-26c9bec5b019" (UID: "010f395f-880c-4b8b-b99f-26c9bec5b019"). InnerVolumeSpecName "kube-api-access-fl7zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:42:28.883667 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.883649    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010f395f-880c-4b8b-b99f-26c9bec5b019-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "010f395f-880c-4b8b-b99f-26c9bec5b019" (UID: "010f395f-880c-4b8b-b99f-26c9bec5b019"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:42:28.883735 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.883678    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010f395f-880c-4b8b-b99f-26c9bec5b019-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "010f395f-880c-4b8b-b99f-26c9bec5b019" (UID: "010f395f-880c-4b8b-b99f-26c9bec5b019"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:42:28.982802 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.982757    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/010f395f-880c-4b8b-b99f-26c9bec5b019-console-serving-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:28.982802 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.982789    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/010f395f-880c-4b8b-b99f-26c9bec5b019-console-oauth-config\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:28.982802 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:28.982804    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl7zn\" (UniqueName: \"kubernetes.io/projected/010f395f-880c-4b8b-b99f-26c9bec5b019-kube-api-access-fl7zn\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:29.418830 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:29.418792    2557 generic.go:356] "Generic (PLEG): container finished" podID="010f395f-880c-4b8b-b99f-26c9bec5b019" containerID="d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2" exitCode=0
Jul 24 18:42:29.419034 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:29.418843    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568cd6f6bb-lrw57"
Jul 24 18:42:29.419034 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:29.418855    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568cd6f6bb-lrw57" event={"ID":"010f395f-880c-4b8b-b99f-26c9bec5b019","Type":"ContainerDied","Data":"d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2"}
Jul 24 18:42:29.419034 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:29.418905    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568cd6f6bb-lrw57" event={"ID":"010f395f-880c-4b8b-b99f-26c9bec5b019","Type":"ContainerDied","Data":"a18a58a3f66e12e7f661835d236dfeede50c3e7217b891d4ee77b2e6bbeed179"}
Jul 24 18:42:29.419034 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:29.418930    2557 scope.go:117] "RemoveContainer" containerID="d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2"
Jul 24 18:42:29.428031 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:29.428008    2557 scope.go:117] "RemoveContainer" containerID="d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2"
Jul 24 18:42:29.428310 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:42:29.428279    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2\": container with ID starting with d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2 not found: ID does not exist" containerID="d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2"
Jul 24 18:42:29.428360 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:29.428318    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2"} err="failed to get container status \"d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2\": rpc error: code = NotFound desc = could not find container \"d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2\": container with ID starting with d69a9a5b41013f7306a9221b6d92846efacbaf96436e9ae3d8746834a47010c2 not found: ID does not exist"
Jul 24 18:42:29.441425 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:29.441398    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568cd6f6bb-lrw57"]
Jul 24 18:42:29.444986 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:29.444962    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-568cd6f6bb-lrw57"]
Jul 24 18:42:30.621177 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:30.621143    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="010f395f-880c-4b8b-b99f-26c9bec5b019" path="/var/lib/kubelet/pods/010f395f-880c-4b8b-b99f-26c9bec5b019/volumes"
Jul 24 18:42:35.445547 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:35.445455    2557 generic.go:356] "Generic (PLEG): container finished" podID="90f2aede-506b-4d4f-95ce-551989d6fa89" containerID="971e3193c511eb7e3be229eedc565b6892b037a21bc1dc635627f052582cf00a" exitCode=0
Jul 24 18:42:35.445991 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:35.445536    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-k4875" event={"ID":"90f2aede-506b-4d4f-95ce-551989d6fa89","Type":"ContainerDied","Data":"971e3193c511eb7e3be229eedc565b6892b037a21bc1dc635627f052582cf00a"}
Jul 24 18:42:35.446066 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:35.446001    2557 scope.go:117] "RemoveContainer" containerID="971e3193c511eb7e3be229eedc565b6892b037a21bc1dc635627f052582cf00a"
Jul 24 18:42:36.450928 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:36.450891    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-k4875" event={"ID":"90f2aede-506b-4d4f-95ce-551989d6fa89","Type":"ContainerStarted","Data":"e4d09723b949fa69f56bc00a2d15f8d50ee9689e37e3f74b6ae57dd6f48f2eed"}
Jul 24 18:42:39.427052 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.426991    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d4579b557-7h8qt" podUID="d4602b25-51b4-47a3-88af-78a600cc94d9" containerName="console" containerID="cri-o://bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb" gracePeriod=15
Jul 24 18:42:39.671218 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.671192    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:42:39.775663 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.775621    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4602b25-51b4-47a3-88af-78a600cc94d9-console-oauth-config\") pod \"d4602b25-51b4-47a3-88af-78a600cc94d9\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") "
Jul 24 18:42:39.775852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.775678    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7w9q\" (UniqueName: \"kubernetes.io/projected/d4602b25-51b4-47a3-88af-78a600cc94d9-kube-api-access-k7w9q\") pod \"d4602b25-51b4-47a3-88af-78a600cc94d9\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") "
Jul 24 18:42:39.775852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.775717    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-trusted-ca-bundle\") pod \"d4602b25-51b4-47a3-88af-78a600cc94d9\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") "
Jul 24 18:42:39.775852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.775765    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-console-config\") pod \"d4602b25-51b4-47a3-88af-78a600cc94d9\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") "
Jul 24 18:42:39.776004 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.775919    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4602b25-51b4-47a3-88af-78a600cc94d9-console-serving-cert\") pod \"d4602b25-51b4-47a3-88af-78a600cc94d9\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") "
Jul 24 18:42:39.776004 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.775982    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-service-ca\") pod \"d4602b25-51b4-47a3-88af-78a600cc94d9\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") "
Jul 24 18:42:39.776101 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.776017    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-oauth-serving-cert\") pod \"d4602b25-51b4-47a3-88af-78a600cc94d9\" (UID: \"d4602b25-51b4-47a3-88af-78a600cc94d9\") "
Jul 24 18:42:39.776191 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.776149    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-console-config" (OuterVolumeSpecName: "console-config") pod "d4602b25-51b4-47a3-88af-78a600cc94d9" (UID: "d4602b25-51b4-47a3-88af-78a600cc94d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:42:39.776191 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.776161    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d4602b25-51b4-47a3-88af-78a600cc94d9" (UID: "d4602b25-51b4-47a3-88af-78a600cc94d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:42:39.776467 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.776421    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-console-config\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:39.776467 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.776444    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-trusted-ca-bundle\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:39.776467 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.776457    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "d4602b25-51b4-47a3-88af-78a600cc94d9" (UID: "d4602b25-51b4-47a3-88af-78a600cc94d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:42:39.776700 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.776512    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d4602b25-51b4-47a3-88af-78a600cc94d9" (UID: "d4602b25-51b4-47a3-88af-78a600cc94d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:42:39.778089 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.778058    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4602b25-51b4-47a3-88af-78a600cc94d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d4602b25-51b4-47a3-88af-78a600cc94d9" (UID: "d4602b25-51b4-47a3-88af-78a600cc94d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:42:39.778249 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.778232    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4602b25-51b4-47a3-88af-78a600cc94d9-kube-api-access-k7w9q" (OuterVolumeSpecName: "kube-api-access-k7w9q") pod "d4602b25-51b4-47a3-88af-78a600cc94d9" (UID: "d4602b25-51b4-47a3-88af-78a600cc94d9"). InnerVolumeSpecName "kube-api-access-k7w9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:42:39.778249 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.778235    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4602b25-51b4-47a3-88af-78a600cc94d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d4602b25-51b4-47a3-88af-78a600cc94d9" (UID: "d4602b25-51b4-47a3-88af-78a600cc94d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:42:39.877481 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.877443    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-oauth-serving-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:39.877481 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.877476    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4602b25-51b4-47a3-88af-78a600cc94d9-console-oauth-config\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:39.877481 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.877485    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7w9q\" (UniqueName: \"kubernetes.io/projected/d4602b25-51b4-47a3-88af-78a600cc94d9-kube-api-access-k7w9q\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:39.877718 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.877494    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4602b25-51b4-47a3-88af-78a600cc94d9-console-serving-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:39.877718 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:39.877506    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4602b25-51b4-47a3-88af-78a600cc94d9-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:42:40.466291 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:40.466253    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4602b25-51b4-47a3-88af-78a600cc94d9" containerID="bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb" exitCode=0
Jul 24 18:42:40.466718 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:40.466299    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4579b557-7h8qt"
Jul 24 18:42:40.466718 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:40.466298    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4579b557-7h8qt" event={"ID":"d4602b25-51b4-47a3-88af-78a600cc94d9","Type":"ContainerDied","Data":"bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb"}
Jul 24 18:42:40.466718 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:40.466422    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4579b557-7h8qt" event={"ID":"d4602b25-51b4-47a3-88af-78a600cc94d9","Type":"ContainerDied","Data":"faa4c9835e4124fcc81d324036a3e93fa25e14a1b936d2e9436079bf4488bc75"}
Jul 24 18:42:40.466718 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:40.466449    2557 scope.go:117] "RemoveContainer" containerID="bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb"
Jul 24 18:42:40.474788 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:40.474770    2557 scope.go:117] "RemoveContainer" containerID="bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb"
Jul 24 18:42:40.475067 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:42:40.475044    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb\": container with ID starting with bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb not found: ID does not exist" containerID="bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb"
Jul 24 18:42:40.475125 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:40.475076    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb"} err="failed to get container status \"bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb\": rpc error: code = NotFound desc = could not find container \"bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb\": container with ID starting with bc9607d191a7428231a12b0ffece3fc72acce26bd1f81132143e5fd6861fe6fb not found: ID does not exist"
Jul 24 18:42:40.488215 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:40.488184    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d4579b557-7h8qt"]
Jul 24 18:42:40.492213 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:40.492178    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d4579b557-7h8qt"]
Jul 24 18:42:40.620479 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:42:40.620445    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4602b25-51b4-47a3-88af-78a600cc94d9" path="/var/lib/kubelet/pods/d4602b25-51b4-47a3-88af-78a600cc94d9/volumes"
Jul 24 18:43:09.546141 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:09.546064    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:09.608429 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:09.608395    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:21.486247 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:21.486210    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:21.538536 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:21.538498    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:25.291203 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:25.291164    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:25.392567 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:25.392534    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:27.542777 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.542742    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d6cfc7488-cmfqn"]
Jul 24 18:43:27.543168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.543013    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010f395f-880c-4b8b-b99f-26c9bec5b019" containerName="console"
Jul 24 18:43:27.543168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.543024    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="010f395f-880c-4b8b-b99f-26c9bec5b019" containerName="console"
Jul 24 18:43:27.543168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.543032    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea865fbf-615d-4d3a-81f7-0b2ed381d33c" containerName="console"
Jul 24 18:43:27.543168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.543038    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea865fbf-615d-4d3a-81f7-0b2ed381d33c" containerName="console"
Jul 24 18:43:27.543168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.543055    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4602b25-51b4-47a3-88af-78a600cc94d9" containerName="console"
Jul 24 18:43:27.543168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.543060    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4602b25-51b4-47a3-88af-78a600cc94d9" containerName="console"
Jul 24 18:43:27.543168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.543105    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4602b25-51b4-47a3-88af-78a600cc94d9" containerName="console"
Jul 24 18:43:27.543168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.543115    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea865fbf-615d-4d3a-81f7-0b2ed381d33c" containerName="console"
Jul 24 18:43:27.543168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.543121    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="010f395f-880c-4b8b-b99f-26c9bec5b019" containerName="console"
Jul 24 18:43:27.547246 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.547228    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.566006 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.565976    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6cfc7488-cmfqn"]
Jul 24 18:43:27.605047 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.605018    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:27.658283 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.658250    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:27.669173 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.669148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-console-config\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.669254 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.669184    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-trusted-ca-bundle\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.669254 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.669212    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsdgt\" (UniqueName: \"kubernetes.io/projected/21092633-e269-4e1e-98f0-01854b71d4bc-kube-api-access-nsdgt\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.669322 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.669272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-service-ca\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.669356 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.669319    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-oauth-serving-cert\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.669426 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.669415    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21092633-e269-4e1e-98f0-01854b71d4bc-console-oauth-config\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.669463 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.669442    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21092633-e269-4e1e-98f0-01854b71d4bc-console-serving-cert\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.770596 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.770559    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-trusted-ca-bundle\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.770596 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.770601    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsdgt\" (UniqueName: \"kubernetes.io/projected/21092633-e269-4e1e-98f0-01854b71d4bc-kube-api-access-nsdgt\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.770768 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.770747    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-service-ca\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.770963 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.770878    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-oauth-serving-cert\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.771059 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.770982    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21092633-e269-4e1e-98f0-01854b71d4bc-console-oauth-config\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.771059 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.771031    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21092633-e269-4e1e-98f0-01854b71d4bc-console-serving-cert\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.771174 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.771084    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-console-config\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.771534 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.771509    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-service-ca\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.771630 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.771539    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-trusted-ca-bundle\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.771798 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.771777    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-oauth-serving-cert\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.771974 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.771959    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-console-config\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.773583 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.773561    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21092633-e269-4e1e-98f0-01854b71d4bc-console-oauth-config\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.773709 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.773685    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21092633-e269-4e1e-98f0-01854b71d4bc-console-serving-cert\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.779248 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.779224    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsdgt\" (UniqueName: \"kubernetes.io/projected/21092633-e269-4e1e-98f0-01854b71d4bc-kube-api-access-nsdgt\") pod \"console-7d6cfc7488-cmfqn\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") " pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.856130 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.856038    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:27.999247 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:27.999211    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6cfc7488-cmfqn"]
Jul 24 18:43:28.002298 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:43:28.002262    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21092633_e269_4e1e_98f0_01854b71d4bc.slice/crio-549cb12838a8fadfda77cbce9ddbca0bc4e95b5a87255996f2b6a68e71187635 WatchSource:0}: Error finding container 549cb12838a8fadfda77cbce9ddbca0bc4e95b5a87255996f2b6a68e71187635: Status 404 returned error can't find the container with id 549cb12838a8fadfda77cbce9ddbca0bc4e95b5a87255996f2b6a68e71187635
Jul 24 18:43:28.647560 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:28.647522    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6cfc7488-cmfqn" event={"ID":"21092633-e269-4e1e-98f0-01854b71d4bc","Type":"ContainerStarted","Data":"7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e"}
Jul 24 18:43:28.647994 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:28.647575    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6cfc7488-cmfqn" event={"ID":"21092633-e269-4e1e-98f0-01854b71d4bc","Type":"ContainerStarted","Data":"549cb12838a8fadfda77cbce9ddbca0bc4e95b5a87255996f2b6a68e71187635"}
Jul 24 18:43:28.667077 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:28.667024    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d6cfc7488-cmfqn" podStartSLOduration=1.667009594 podStartE2EDuration="1.667009594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:43:28.665451686 +0000 UTC m=+196.590404278" watchObservedRunningTime="2026-07-24 18:43:28.667009594 +0000 UTC m=+196.591962188"
Jul 24 18:43:34.053809 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:34.053767    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:34.165691 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:34.165655    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:37.856920 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:37.856884    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:37.857361 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:37.856947    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:37.861878 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:37.861850    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:38.691952 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:38.691922    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:43:38.737613 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:38.737582    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6956bc5d94-jkd4z"]
Jul 24 18:43:38.851807 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:38.851770    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:38.954870 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:38.954779    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:39.016824 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:39.016794    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:43:42.801144 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:43:42.801102    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:01.952400 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:01.952344    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:02.043172 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:02.043138    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:03.756945 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:03.756875    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6956bc5d94-jkd4z" podUID="09915647-88a7-4ddc-b78d-2fd99ae2c55f" containerName="console" containerID="cri-o://47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d" gracePeriod=15
Jul 24 18:44:03.995930 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:03.995904    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:44:04.063249 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.063160    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-oauth-serving-cert\") pod \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") "
Jul 24 18:44:04.063249 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.063203    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbt2w\" (UniqueName: \"kubernetes.io/projected/09915647-88a7-4ddc-b78d-2fd99ae2c55f-kube-api-access-hbt2w\") pod \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") "
Jul 24 18:44:04.063249 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.063226    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-service-ca\") pod \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") "
Jul 24 18:44:04.063551 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.063270    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-serving-cert\") pod \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") "
Jul 24 18:44:04.063551 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.063290    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-config\") pod \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") "
Jul 24 18:44:04.063551 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.063314    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-trusted-ca-bundle\") pod \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") "
Jul 24 18:44:04.063551 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.063332    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-oauth-config\") pod \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\" (UID: \"09915647-88a7-4ddc-b78d-2fd99ae2c55f\") "
Jul 24 18:44:04.063790 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.063753    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "09915647-88a7-4ddc-b78d-2fd99ae2c55f" (UID: "09915647-88a7-4ddc-b78d-2fd99ae2c55f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:44:04.063859 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.063833    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-service-ca" (OuterVolumeSpecName: "service-ca") pod "09915647-88a7-4ddc-b78d-2fd99ae2c55f" (UID: "09915647-88a7-4ddc-b78d-2fd99ae2c55f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:44:04.063915 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.063880    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-config" (OuterVolumeSpecName: "console-config") pod "09915647-88a7-4ddc-b78d-2fd99ae2c55f" (UID: "09915647-88a7-4ddc-b78d-2fd99ae2c55f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:44:04.063967 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.063908    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "09915647-88a7-4ddc-b78d-2fd99ae2c55f" (UID: "09915647-88a7-4ddc-b78d-2fd99ae2c55f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:44:04.065557 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.065534    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09915647-88a7-4ddc-b78d-2fd99ae2c55f-kube-api-access-hbt2w" (OuterVolumeSpecName: "kube-api-access-hbt2w") pod "09915647-88a7-4ddc-b78d-2fd99ae2c55f" (UID: "09915647-88a7-4ddc-b78d-2fd99ae2c55f"). InnerVolumeSpecName "kube-api-access-hbt2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:44:04.065698 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.065678    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "09915647-88a7-4ddc-b78d-2fd99ae2c55f" (UID: "09915647-88a7-4ddc-b78d-2fd99ae2c55f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:44:04.065738 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.065693    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "09915647-88a7-4ddc-b78d-2fd99ae2c55f" (UID: "09915647-88a7-4ddc-b78d-2fd99ae2c55f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:44:04.164045 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.164005    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-serving-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:44:04.164045 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.164038    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-config\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:44:04.164045 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.164048    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-trusted-ca-bundle\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:44:04.164045 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.164056    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09915647-88a7-4ddc-b78d-2fd99ae2c55f-console-oauth-config\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:44:04.164304 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.164066    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-oauth-serving-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:44:04.164304 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.164075    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbt2w\" (UniqueName: \"kubernetes.io/projected/09915647-88a7-4ddc-b78d-2fd99ae2c55f-kube-api-access-hbt2w\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:44:04.164304 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.164083    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09915647-88a7-4ddc-b78d-2fd99ae2c55f-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:44:04.785824 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.785788    2557 generic.go:356] "Generic (PLEG): container finished" podID="09915647-88a7-4ddc-b78d-2fd99ae2c55f" containerID="47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d" exitCode=0
Jul 24 18:44:04.786217 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.785829    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6956bc5d94-jkd4z"
Jul 24 18:44:04.786217 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.785852    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6956bc5d94-jkd4z" event={"ID":"09915647-88a7-4ddc-b78d-2fd99ae2c55f","Type":"ContainerDied","Data":"47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d"}
Jul 24 18:44:04.786217 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.785897    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6956bc5d94-jkd4z" event={"ID":"09915647-88a7-4ddc-b78d-2fd99ae2c55f","Type":"ContainerDied","Data":"9eb69267b0b3ee7dd5db7bb7ccd9ef954467ae963de1025796ed8a370f36333a"}
Jul 24 18:44:04.786217 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.785916    2557 scope.go:117] "RemoveContainer" containerID="47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d"
Jul 24 18:44:04.793968 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.793950    2557 scope.go:117] "RemoveContainer" containerID="47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d"
Jul 24 18:44:04.794203 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:44:04.794186    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d\": container with ID starting with 47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d not found: ID does not exist" containerID="47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d"
Jul 24 18:44:04.794282 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.794209    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d"} err="failed to get container status \"47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d\": rpc error: code = NotFound desc = could not find container \"47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d\": container with ID starting with 47e6b5e597e8aaf6022734aec188636ae37e0e207773b2b4636d05d6010eba8d not found: ID does not exist"
Jul 24 18:44:04.802161 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.802138    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6956bc5d94-jkd4z"]
Jul 24 18:44:04.804714 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:04.804684    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6956bc5d94-jkd4z"]
Jul 24 18:44:06.206935 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:06.206900    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:06.266578 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:06.266548    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:06.620320 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:06.620290    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09915647-88a7-4ddc-b78d-2fd99ae2c55f" path="/var/lib/kubelet/pods/09915647-88a7-4ddc-b78d-2fd99ae2c55f/volumes"
Jul 24 18:44:22.858974 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:22.858939    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:22.960335 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:22.960295    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:23.892425 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:23.892363    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:25.339213 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:25.339181    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:25.883493 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:25.883449    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4"]
Jul 24 18:44:25.883739 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:25.883728    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09915647-88a7-4ddc-b78d-2fd99ae2c55f" containerName="console"
Jul 24 18:44:25.883781 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:25.883741    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="09915647-88a7-4ddc-b78d-2fd99ae2c55f" containerName="console"
Jul 24 18:44:25.883814 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:25.883799    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="09915647-88a7-4ddc-b78d-2fd99ae2c55f" containerName="console"
Jul 24 18:44:25.888142 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:25.888123    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4"
Jul 24 18:44:25.890748 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:25.890724    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-72sxm\""
Jul 24 18:44:25.890885 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:25.890771    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 24 18:44:25.891083 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:25.891068    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 24 18:44:25.901559 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:25.901533    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4"]
Jul 24 18:44:25.937958 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:25.937924    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnj9z\" (UniqueName: \"kubernetes.io/projected/8900e359-69d5-4827-88c0-7afd64238099-kube-api-access-gnj9z\") pod \"cert-manager-operator-controller-manager-55c444bf86-7hwv4\" (UID: \"8900e359-69d5-4827-88c0-7afd64238099\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4"
Jul 24 18:44:25.938128 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:25.937970    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8900e359-69d5-4827-88c0-7afd64238099-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7hwv4\" (UID: \"8900e359-69d5-4827-88c0-7afd64238099\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4"
Jul 24 18:44:26.039297 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:26.039260    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnj9z\" (UniqueName: \"kubernetes.io/projected/8900e359-69d5-4827-88c0-7afd64238099-kube-api-access-gnj9z\") pod \"cert-manager-operator-controller-manager-55c444bf86-7hwv4\" (UID: \"8900e359-69d5-4827-88c0-7afd64238099\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4"
Jul 24 18:44:26.039473 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:26.039311    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8900e359-69d5-4827-88c0-7afd64238099-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7hwv4\" (UID: \"8900e359-69d5-4827-88c0-7afd64238099\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4"
Jul 24 18:44:26.039688 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:26.039667    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8900e359-69d5-4827-88c0-7afd64238099-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7hwv4\" (UID: \"8900e359-69d5-4827-88c0-7afd64238099\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4"
Jul 24 18:44:26.052867 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:26.052844    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnj9z\" (UniqueName: \"kubernetes.io/projected/8900e359-69d5-4827-88c0-7afd64238099-kube-api-access-gnj9z\") pod \"cert-manager-operator-controller-manager-55c444bf86-7hwv4\" (UID: \"8900e359-69d5-4827-88c0-7afd64238099\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4"
Jul 24 18:44:26.197603 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:26.197510    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4"
Jul 24 18:44:26.337905 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:26.337872    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4"]
Jul 24 18:44:26.341451 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:44:26.341423    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8900e359_69d5_4827_88c0_7afd64238099.slice/crio-f2005d1506f3115ac75c381c072d3fbdc42427e172c6550a8d2b47d14fe51888 WatchSource:0}: Error finding container f2005d1506f3115ac75c381c072d3fbdc42427e172c6550a8d2b47d14fe51888: Status 404 returned error can't find the container with id f2005d1506f3115ac75c381c072d3fbdc42427e172c6550a8d2b47d14fe51888
Jul 24 18:44:26.868249 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:26.868214    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4" event={"ID":"8900e359-69d5-4827-88c0-7afd64238099","Type":"ContainerStarted","Data":"f2005d1506f3115ac75c381c072d3fbdc42427e172c6550a8d2b47d14fe51888"}
Jul 24 18:44:27.514112 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:27.514073    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:27.614852 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:27.614811    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:29.884677 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:29.884630    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4" event={"ID":"8900e359-69d5-4827-88c0-7afd64238099","Type":"ContainerStarted","Data":"81f0e2d30a70ac99bc22b7acd7fba50228589c7a20c244e87efe8fca5d7ce5d2"}
Jul 24 18:44:29.911885 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:29.911831    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7hwv4" podStartSLOduration=1.9838960970000001 podStartE2EDuration="4.911812685s" totalImagesPullingTime="2.927916588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:29.910523359 +0000 UTC m=+257.835475943" watchObservedRunningTime="2026-07-24 18:44:29.911812685 +0000 UTC m=+257.836765279"
Jul 24 18:44:29.977840 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:29.977806    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:30.099506 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.099466    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:30.333784 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.333748    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:30.337710 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.337681    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7rrbk"]
Jul 24 18:44:30.340868 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.340844    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk"
Jul 24 18:44:30.345594 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.345570    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mktvn\""
Jul 24 18:44:30.346677 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.346655    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 18:44:30.346677 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.346670    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 18:44:30.356846 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.356809    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7rrbk"]
Jul 24 18:44:30.440259 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.440186    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:30.482758 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.482715    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxk9h\" (UniqueName: \"kubernetes.io/projected/554fa5f0-828b-4996-9d40-a53da2b8079e-kube-api-access-qxk9h\") pod \"cert-manager-webhook-6486ffd997-7rrbk\" (UID: \"554fa5f0-828b-4996-9d40-a53da2b8079e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk"
Jul 24 18:44:30.482939 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.482771    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/554fa5f0-828b-4996-9d40-a53da2b8079e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7rrbk\" (UID: \"554fa5f0-828b-4996-9d40-a53da2b8079e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk"
Jul 24 18:44:30.583747 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.583704    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxk9h\" (UniqueName: \"kubernetes.io/projected/554fa5f0-828b-4996-9d40-a53da2b8079e-kube-api-access-qxk9h\") pod \"cert-manager-webhook-6486ffd997-7rrbk\" (UID: \"554fa5f0-828b-4996-9d40-a53da2b8079e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk"
Jul 24 18:44:30.583964 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.583789    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/554fa5f0-828b-4996-9d40-a53da2b8079e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7rrbk\" (UID: \"554fa5f0-828b-4996-9d40-a53da2b8079e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk"
Jul 24 18:44:30.601460 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.601434    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxk9h\" (UniqueName: \"kubernetes.io/projected/554fa5f0-828b-4996-9d40-a53da2b8079e-kube-api-access-qxk9h\") pod \"cert-manager-webhook-6486ffd997-7rrbk\" (UID: \"554fa5f0-828b-4996-9d40-a53da2b8079e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk"
Jul 24 18:44:30.601460 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.601458    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/554fa5f0-828b-4996-9d40-a53da2b8079e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7rrbk\" (UID: \"554fa5f0-828b-4996-9d40-a53da2b8079e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk"
Jul 24 18:44:30.650042 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.650003    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk"
Jul 24 18:44:30.680003 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.679967    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"]
Jul 24 18:44:30.683574 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.683547    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:30.686303 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.686278    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 18:44:30.686450 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.686328    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 18:44:30.686450 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.686345    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gz9n7\""
Jul 24 18:44:30.695260 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.695233    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"]
Jul 24 18:44:30.785017 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.784967    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j7qk\" (UniqueName: \"kubernetes.io/projected/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-kube-api-access-5j7qk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2\" (UID: \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:30.785205 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.785057    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2\" (UID: \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:30.785205 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.785120    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2\" (UID: \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:30.786698 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.786672    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7rrbk"]
Jul 24 18:44:30.789958 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:44:30.789924    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod554fa5f0_828b_4996_9d40_a53da2b8079e.slice/crio-6cad310d2e4f04c7188105adc35cf63ff30a0a33d8744a2a560a93977e94fa56 WatchSource:0}: Error finding container 6cad310d2e4f04c7188105adc35cf63ff30a0a33d8744a2a560a93977e94fa56: Status 404 returned error can't find the container with id 6cad310d2e4f04c7188105adc35cf63ff30a0a33d8744a2a560a93977e94fa56
Jul 24 18:44:30.885665 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.885572    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2\" (UID: \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:30.885665 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.885649    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j7qk\" (UniqueName: \"kubernetes.io/projected/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-kube-api-access-5j7qk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2\" (UID: \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:30.886159 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.885693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2\" (UID: \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:30.886159 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.885994    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2\" (UID: \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:30.886159 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.886052    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2\" (UID: \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:30.890531 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.890498    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk" event={"ID":"554fa5f0-828b-4996-9d40-a53da2b8079e","Type":"ContainerStarted","Data":"6cad310d2e4f04c7188105adc35cf63ff30a0a33d8744a2a560a93977e94fa56"}
Jul 24 18:44:30.896683 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.896662    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j7qk\" (UniqueName: \"kubernetes.io/projected/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-kube-api-access-5j7qk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2\" (UID: \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:30.994921 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:30.994888    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:31.130836 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:31.130816    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"]
Jul 24 18:44:31.132904 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:44:31.132877    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fb2771_8664_44b9_b9d0_8d4966fb3cc7.slice/crio-a41a237be09adfba0c68b53c197acdf904fa14a7ede36fb10fde00a0c3bc7f1f WatchSource:0}: Error finding container a41a237be09adfba0c68b53c197acdf904fa14a7ede36fb10fde00a0c3bc7f1f: Status 404 returned error can't find the container with id a41a237be09adfba0c68b53c197acdf904fa14a7ede36fb10fde00a0c3bc7f1f
Jul 24 18:44:31.897897 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:31.897849    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2" event={"ID":"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7","Type":"ContainerStarted","Data":"a41a237be09adfba0c68b53c197acdf904fa14a7ede36fb10fde00a0c3bc7f1f"}
Jul 24 18:44:32.139719 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:32.139672    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:32.389154 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:32.389079    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:33.908682 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:33.908587    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk" event={"ID":"554fa5f0-828b-4996-9d40-a53da2b8079e","Type":"ContainerStarted","Data":"e51eceac1965778c4d4d9fb325b471797414e6faf357bb746c481f0c5badb893"}
Jul 24 18:44:33.909104 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:33.908709    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk"
Jul 24 18:44:33.927770 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:33.927708    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk" podStartSLOduration=1.1498895359999999 podStartE2EDuration="3.927685812s" totalImagesPullingTime="2.777796276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:33.925412834 +0000 UTC m=+261.850365429" watchObservedRunningTime="2026-07-24 18:44:33.927685812 +0000 UTC m=+261.852638408"
Jul 24 18:44:34.701358 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:34.701276    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:34.874059 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:34.874020    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:37.927971 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:37.927884    2557 generic.go:356] "Generic (PLEG): container finished" podID="e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" containerID="727c8acc46416a118805832d882f6fc5302190912e76de4edae286ec46ca0f63" exitCode=0
Jul 24 18:44:37.928347 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:37.927968    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2" event={"ID":"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7","Type":"ContainerDied","Data":"727c8acc46416a118805832d882f6fc5302190912e76de4edae286ec46ca0f63"}
Jul 24 18:44:39.915363 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:39.915327    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7rrbk"
Jul 24 18:44:40.539781 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:40.539750    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:40.601601 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:40.601570    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:40.942497 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:40.942406    2557 generic.go:356] "Generic (PLEG): container finished" podID="e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" containerID="a2613157f5214f77726703192b231d38cf0d7b6263bfa291d2c72883ba5f22c0" exitCode=0
Jul 24 18:44:40.942497 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:40.942469    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2" event={"ID":"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7","Type":"ContainerDied","Data":"a2613157f5214f77726703192b231d38cf0d7b6263bfa291d2c72883ba5f22c0"}
Jul 24 18:44:48.982768 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:48.982726    2557 generic.go:356] "Generic (PLEG): container finished" podID="e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" containerID="d517a88f67a7aea1ae564362de3a0e97d20cc6b631ad84927240278c65f3d5c3" exitCode=0
Jul 24 18:44:48.983234 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:48.982805    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2" event={"ID":"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7","Type":"ContainerDied","Data":"d517a88f67a7aea1ae564362de3a0e97d20cc6b631ad84927240278c65f3d5c3"}
Jul 24 18:44:50.114779 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.114753    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:50.159573 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.159538    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-util\") pod \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\" (UID: \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\") "
Jul 24 18:44:50.159727 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.159609    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j7qk\" (UniqueName: \"kubernetes.io/projected/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-kube-api-access-5j7qk\") pod \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\" (UID: \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\") "
Jul 24 18:44:50.159727 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.159646    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-bundle\") pod \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\" (UID: \"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7\") "
Jul 24 18:44:50.160041 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.160019    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-bundle" (OuterVolumeSpecName: "bundle") pod "e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" (UID: "e0fb2771-8664-44b9-b9d0-8d4966fb3cc7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:44:50.161844 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.161816    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-kube-api-access-5j7qk" (OuterVolumeSpecName: "kube-api-access-5j7qk") pod "e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" (UID: "e0fb2771-8664-44b9-b9d0-8d4966fb3cc7"). InnerVolumeSpecName "kube-api-access-5j7qk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:44:50.164173 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.164151    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-util" (OuterVolumeSpecName: "util") pod "e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" (UID: "e0fb2771-8664-44b9-b9d0-8d4966fb3cc7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:44:50.260151 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.260070    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-bundle\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:44:50.260151 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.260098    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-util\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:44:50.260151 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.260108    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j7qk\" (UniqueName: \"kubernetes.io/projected/e0fb2771-8664-44b9-b9d0-8d4966fb3cc7-kube-api-access-5j7qk\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:44:50.495423 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.495383    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tz9nx"]
Jul 24 18:44:50.495687 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.495675    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" containerName="pull"
Jul 24 18:44:50.495728 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.495690    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" containerName="pull"
Jul 24 18:44:50.495728 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.495707    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" containerName="extract"
Jul 24 18:44:50.495728 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.495716    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" containerName="extract"
Jul 24 18:44:50.495838 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.495735    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" containerName="util"
Jul 24 18:44:50.495838 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.495743    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" containerName="util"
Jul 24 18:44:50.495838 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.495822    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0fb2771-8664-44b9-b9d0-8d4966fb3cc7" containerName="extract"
Jul 24 18:44:50.525804 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.525733    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tz9nx"]
Jul 24 18:44:50.525925 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.525829    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tz9nx"
Jul 24 18:44:50.528237 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.528218    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nwwjq\""
Jul 24 18:44:50.563251 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.563217    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn48r\" (UniqueName: \"kubernetes.io/projected/419853f5-92a8-4cc3-8de6-295f486f4e2e-kube-api-access-kn48r\") pod \"cert-manager-55b4d954d5-tz9nx\" (UID: \"419853f5-92a8-4cc3-8de6-295f486f4e2e\") " pod="cert-manager/cert-manager-55b4d954d5-tz9nx"
Jul 24 18:44:50.563447 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.563265    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/419853f5-92a8-4cc3-8de6-295f486f4e2e-bound-sa-token\") pod \"cert-manager-55b4d954d5-tz9nx\" (UID: \"419853f5-92a8-4cc3-8de6-295f486f4e2e\") " pod="cert-manager/cert-manager-55b4d954d5-tz9nx"
Jul 24 18:44:50.663980 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.663941    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn48r\" (UniqueName: \"kubernetes.io/projected/419853f5-92a8-4cc3-8de6-295f486f4e2e-kube-api-access-kn48r\") pod \"cert-manager-55b4d954d5-tz9nx\" (UID: \"419853f5-92a8-4cc3-8de6-295f486f4e2e\") " pod="cert-manager/cert-manager-55b4d954d5-tz9nx"
Jul 24 18:44:50.664179 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.663999    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/419853f5-92a8-4cc3-8de6-295f486f4e2e-bound-sa-token\") pod \"cert-manager-55b4d954d5-tz9nx\" (UID: \"419853f5-92a8-4cc3-8de6-295f486f4e2e\") " pod="cert-manager/cert-manager-55b4d954d5-tz9nx"
Jul 24 18:44:50.673002 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.672971    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/419853f5-92a8-4cc3-8de6-295f486f4e2e-bound-sa-token\") pod \"cert-manager-55b4d954d5-tz9nx\" (UID: \"419853f5-92a8-4cc3-8de6-295f486f4e2e\") " pod="cert-manager/cert-manager-55b4d954d5-tz9nx"
Jul 24 18:44:50.673125 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.673018    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn48r\" (UniqueName: \"kubernetes.io/projected/419853f5-92a8-4cc3-8de6-295f486f4e2e-kube-api-access-kn48r\") pod \"cert-manager-55b4d954d5-tz9nx\" (UID: \"419853f5-92a8-4cc3-8de6-295f486f4e2e\") " pod="cert-manager/cert-manager-55b4d954d5-tz9nx"
Jul 24 18:44:50.835305 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.835209    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tz9nx"
Jul 24 18:44:50.972883 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.972844    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tz9nx"]
Jul 24 18:44:50.976827 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:44:50.976786    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod419853f5_92a8_4cc3_8de6_295f486f4e2e.slice/crio-9e0eb75c91713a990ef0c1991b89ce8900ddb9284166461735b5d3eb487629dd WatchSource:0}: Error finding container 9e0eb75c91713a990ef0c1991b89ce8900ddb9284166461735b5d3eb487629dd: Status 404 returned error can't find the container with id 9e0eb75c91713a990ef0c1991b89ce8900ddb9284166461735b5d3eb487629dd
Jul 24 18:44:50.993294 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.993261    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2" event={"ID":"e0fb2771-8664-44b9-b9d0-8d4966fb3cc7","Type":"ContainerDied","Data":"a41a237be09adfba0c68b53c197acdf904fa14a7ede36fb10fde00a0c3bc7f1f"}
Jul 24 18:44:50.993461 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.993339    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a41a237be09adfba0c68b53c197acdf904fa14a7ede36fb10fde00a0c3bc7f1f"
Jul 24 18:44:50.993461 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.993279    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fts7v2"
Jul 24 18:44:50.994620 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:50.994594    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tz9nx" event={"ID":"419853f5-92a8-4cc3-8de6-295f486f4e2e","Type":"ContainerStarted","Data":"9e0eb75c91713a990ef0c1991b89ce8900ddb9284166461735b5d3eb487629dd"}
Jul 24 18:44:52.000392 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:52.000351    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tz9nx" event={"ID":"419853f5-92a8-4cc3-8de6-295f486f4e2e","Type":"ContainerStarted","Data":"64e0d3308d7d1eafc1a1da0f1fa0091061dbc91dc1760db474e3ff65c30ea297"}
Jul 24 18:44:52.017396 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:52.017323    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-tz9nx" podStartSLOduration=2.017308825 podStartE2EDuration="2.017308825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:52.015654305 +0000 UTC m=+279.940606902" watchObservedRunningTime="2026-07-24 18:44:52.017308825 +0000 UTC m=+279.942261419"
Jul 24 18:44:52.640484 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:52.640433    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:52.739570 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:52.739528    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:58.137857 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:58.137802    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:58.234761 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:44:58.234723    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:00.206197 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:00.206165    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:12.471572 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:12.471543    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 18:45:13.796584 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:13.796535    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:13.886345 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:13.886308    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:14.404320 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.404282    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:14.622612 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.622574    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:14.719979 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.719949    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:14.741386 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.741350    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"]
Jul 24 18:45:14.743864 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.743835    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.746842 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.746819    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 18:45:14.746973 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.746876    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 18:45:14.746973 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.746901    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jb8gh\""
Jul 24 18:45:14.747296 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.747282    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 18:45:14.747344 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.747291    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 18:45:14.762659 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.762631    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"]
Jul 24 18:45:14.850977 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.850935    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ba652a1-f452-45ec-a39c-ef023be1771d-webhook-cert\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.850977 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.850979    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ba652a1-f452-45ec-a39c-ef023be1771d-manifests\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.851436 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.851002    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ba652a1-f452-45ec-a39c-ef023be1771d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.851436 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.851089    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh5w5\" (UniqueName: \"kubernetes.io/projected/4ba652a1-f452-45ec-a39c-ef023be1771d-kube-api-access-zh5w5\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.851436 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.851140    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ba652a1-f452-45ec-a39c-ef023be1771d-tmp\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.949186 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.949149    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:14.952297 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.952274    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh5w5\" (UniqueName: \"kubernetes.io/projected/4ba652a1-f452-45ec-a39c-ef023be1771d-kube-api-access-zh5w5\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.952427 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.952317    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ba652a1-f452-45ec-a39c-ef023be1771d-tmp\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.952427 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.952357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ba652a1-f452-45ec-a39c-ef023be1771d-webhook-cert\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.952427 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.952415    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ba652a1-f452-45ec-a39c-ef023be1771d-manifests\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.952550 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.952440    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ba652a1-f452-45ec-a39c-ef023be1771d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.952854 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.952825    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ba652a1-f452-45ec-a39c-ef023be1771d-manifests\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.954702 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.954680    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ba652a1-f452-45ec-a39c-ef023be1771d-tmp\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.954938 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.954917    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ba652a1-f452-45ec-a39c-ef023be1771d-webhook-cert\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.955023 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.955004    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ba652a1-f452-45ec-a39c-ef023be1771d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:14.967579 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:14.967549    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh5w5\" (UniqueName: \"kubernetes.io/projected/4ba652a1-f452-45ec-a39c-ef023be1771d-kube-api-access-zh5w5\") pod \"opendatahub-operator-controller-manager-859dddff6f-2mmwz\" (UID: \"4ba652a1-f452-45ec-a39c-ef023be1771d\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:15.042483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:15.042394    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:15.053483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:15.053453    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:15.142271 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:15.142240    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:15.196500 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:15.196473    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"]
Jul 24 18:45:15.198952 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:45:15.198923    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba652a1_f452_45ec_a39c_ef023be1771d.slice/crio-7b1c2fa2c5ef1de5540bfb566846b347142546740623cc41611ec8863c3e5711 WatchSource:0}: Error finding container 7b1c2fa2c5ef1de5540bfb566846b347142546740623cc41611ec8863c3e5711: Status 404 returned error can't find the container with id 7b1c2fa2c5ef1de5540bfb566846b347142546740623cc41611ec8863c3e5711
Jul 24 18:45:15.200900 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:15.200884    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 18:45:15.236480 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:15.236448    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:15.309838 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:15.309748    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:15.416553 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:15.416513    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:15.507164 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:15.507135    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:16.105410 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:16.105353    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz" event={"ID":"4ba652a1-f452-45ec-a39c-ef023be1771d","Type":"ContainerStarted","Data":"7b1c2fa2c5ef1de5540bfb566846b347142546740623cc41611ec8863c3e5711"}
Jul 24 18:45:20.127895 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:20.127859    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz" event={"ID":"4ba652a1-f452-45ec-a39c-ef023be1771d","Type":"ContainerStarted","Data":"e8c1ce7698f4ab260d38a1cb74b0381a88fc67eba2082163b81d760115b31331"}
Jul 24 18:45:21.133317 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:21.133277    2557 generic.go:356] "Generic (PLEG): container finished" podID="4ba652a1-f452-45ec-a39c-ef023be1771d" containerID="e8c1ce7698f4ab260d38a1cb74b0381a88fc67eba2082163b81d760115b31331" exitCode=0
Jul 24 18:45:21.133725 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:21.133333    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz" event={"ID":"4ba652a1-f452-45ec-a39c-ef023be1771d","Type":"ContainerDied","Data":"e8c1ce7698f4ab260d38a1cb74b0381a88fc67eba2082163b81d760115b31331"}
Jul 24 18:45:22.139524 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:22.139488    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz" event={"ID":"4ba652a1-f452-45ec-a39c-ef023be1771d","Type":"ContainerStarted","Data":"ceae41155c4cd0e13098b2e3011d7c0a173ab574989011bd303df27a1d8eea29"}
Jul 24 18:45:22.139923 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:22.139628    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:22.164217 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:22.164165    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz" podStartSLOduration=2.91361009 podStartE2EDuration="8.164147833s" totalImagesPullingTime="4.21303154s" totalInitContainerRuntime="1.037506203s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:22.162362095 +0000 UTC m=+310.087314691" watchObservedRunningTime="2026-07-24 18:45:22.164147833 +0000 UTC m=+310.089100426"
Jul 24 18:45:22.431746 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:22.431657    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:22.531492 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:22.531456    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:26.814640 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:26.814594    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:28.258754 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:28.258717    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:33.145729 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:33.145694    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-2mmwz"
Jul 24 18:45:34.798880 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:34.798844    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:34.942706 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:34.942671    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:35.692034 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.691996    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rd4zm"]
Jul 24 18:45:35.695124 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.695105    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm"
Jul 24 18:45:35.698700 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.698678    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-smm95\""
Jul 24 18:45:35.698898 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.698881    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 24 18:45:35.706601 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.706573    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rd4zm"]
Jul 24 18:45:35.777473 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.777441    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:35.833735 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.833697    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0cfb807-0130-4b06-8cbc-b769b5b6a49c-cert\") pod \"odh-model-controller-7998c67dc4-rd4zm\" (UID: \"c0cfb807-0130-4b06-8cbc-b769b5b6a49c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm"
Jul 24 18:45:35.834118 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.833749    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7x57\" (UniqueName: \"kubernetes.io/projected/c0cfb807-0130-4b06-8cbc-b769b5b6a49c-kube-api-access-s7x57\") pod \"odh-model-controller-7998c67dc4-rd4zm\" (UID: \"c0cfb807-0130-4b06-8cbc-b769b5b6a49c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm"
Jul 24 18:45:35.882680 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.882650    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:35.934897 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.934857    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0cfb807-0130-4b06-8cbc-b769b5b6a49c-cert\") pod \"odh-model-controller-7998c67dc4-rd4zm\" (UID: \"c0cfb807-0130-4b06-8cbc-b769b5b6a49c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm"
Jul 24 18:45:35.935095 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.934904    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7x57\" (UniqueName: \"kubernetes.io/projected/c0cfb807-0130-4b06-8cbc-b769b5b6a49c-kube-api-access-s7x57\") pod \"odh-model-controller-7998c67dc4-rd4zm\" (UID: \"c0cfb807-0130-4b06-8cbc-b769b5b6a49c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm"
Jul 24 18:45:35.935095 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:45:35.935024    2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 24 18:45:35.935211 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:45:35.935121    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0cfb807-0130-4b06-8cbc-b769b5b6a49c-cert podName:c0cfb807-0130-4b06-8cbc-b769b5b6a49c nodeName:}" failed. No retries permitted until 2026-07-24 18:45:36.435098742 +0000 UTC m=+324.360051317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c0cfb807-0130-4b06-8cbc-b769b5b6a49c-cert") pod "odh-model-controller-7998c67dc4-rd4zm" (UID: "c0cfb807-0130-4b06-8cbc-b769b5b6a49c") : secret "odh-model-controller-webhook-cert" not found
Jul 24 18:45:35.944663 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.944587    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7x57\" (UniqueName: \"kubernetes.io/projected/c0cfb807-0130-4b06-8cbc-b769b5b6a49c-kube-api-access-s7x57\") pod \"odh-model-controller-7998c67dc4-rd4zm\" (UID: \"c0cfb807-0130-4b06-8cbc-b769b5b6a49c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm"
Jul 24 18:45:35.974488 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:35.974458    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:36.115148 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.115110    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:36.439326 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.439283    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0cfb807-0130-4b06-8cbc-b769b5b6a49c-cert\") pod \"odh-model-controller-7998c67dc4-rd4zm\" (UID: \"c0cfb807-0130-4b06-8cbc-b769b5b6a49c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm"
Jul 24 18:45:36.442053 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.442015    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0cfb807-0130-4b06-8cbc-b769b5b6a49c-cert\") pod \"odh-model-controller-7998c67dc4-rd4zm\" (UID: \"c0cfb807-0130-4b06-8cbc-b769b5b6a49c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm"
Jul 24 18:45:36.444128 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.444098    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ct8jj"]
Jul 24 18:45:36.447438 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.447414    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj"
Jul 24 18:45:36.450312 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.450288    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 24 18:45:36.473389 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.473350    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ct8jj"]
Jul 24 18:45:36.511280 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.511246    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:36.540621 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.540586    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wbj2\" (UniqueName: \"kubernetes.io/projected/8009cf55-e775-4149-b7ba-0033f1951ad8-kube-api-access-5wbj2\") pod \"model-serving-api-54d89bd5fc-ct8jj\" (UID: \"8009cf55-e775-4149-b7ba-0033f1951ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj"
Jul 24 18:45:36.540809 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.540658    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8009cf55-e775-4149-b7ba-0033f1951ad8-tls-certs\") pod \"model-serving-api-54d89bd5fc-ct8jj\" (UID: \"8009cf55-e775-4149-b7ba-0033f1951ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj"
Jul 24 18:45:36.604880 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.604839    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm"
Jul 24 18:45:36.641168 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.641119    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wbj2\" (UniqueName: \"kubernetes.io/projected/8009cf55-e775-4149-b7ba-0033f1951ad8-kube-api-access-5wbj2\") pod \"model-serving-api-54d89bd5fc-ct8jj\" (UID: \"8009cf55-e775-4149-b7ba-0033f1951ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj"
Jul 24 18:45:36.641359 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.641260    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8009cf55-e775-4149-b7ba-0033f1951ad8-tls-certs\") pod \"model-serving-api-54d89bd5fc-ct8jj\" (UID: \"8009cf55-e775-4149-b7ba-0033f1951ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj"
Jul 24 18:45:36.641477 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:45:36.641446    2557 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 24 18:45:36.641535 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:45:36.641522    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8009cf55-e775-4149-b7ba-0033f1951ad8-tls-certs podName:8009cf55-e775-4149-b7ba-0033f1951ad8 nodeName:}" failed. No retries permitted until 2026-07-24 18:45:37.141501746 +0000 UTC m=+325.066454323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8009cf55-e775-4149-b7ba-0033f1951ad8-tls-certs") pod "model-serving-api-54d89bd5fc-ct8jj" (UID: "8009cf55-e775-4149-b7ba-0033f1951ad8") : secret "model-serving-api-tls" not found
Jul 24 18:45:36.652091 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.652056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wbj2\" (UniqueName: \"kubernetes.io/projected/8009cf55-e775-4149-b7ba-0033f1951ad8-kube-api-access-5wbj2\") pod \"model-serving-api-54d89bd5fc-ct8jj\" (UID: \"8009cf55-e775-4149-b7ba-0033f1951ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj"
Jul 24 18:45:36.764738 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.764707    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rd4zm"]
Jul 24 18:45:36.768160 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:45:36.768123    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0cfb807_0130_4b06_8cbc_b769b5b6a49c.slice/crio-c2686924143e664f25e206f5bc31aab42e4da0f80ac07097edc505a4c73a3515 WatchSource:0}: Error finding container c2686924143e664f25e206f5bc31aab42e4da0f80ac07097edc505a4c73a3515: Status 404 returned error can't find the container with id c2686924143e664f25e206f5bc31aab42e4da0f80ac07097edc505a4c73a3515
Jul 24 18:45:36.910710 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:36.910678    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:37.146273 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:37.146175    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8009cf55-e775-4149-b7ba-0033f1951ad8-tls-certs\") pod \"model-serving-api-54d89bd5fc-ct8jj\" (UID: \"8009cf55-e775-4149-b7ba-0033f1951ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj"
Jul 24 18:45:37.148749 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:37.148716    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8009cf55-e775-4149-b7ba-0033f1951ad8-tls-certs\") pod \"model-serving-api-54d89bd5fc-ct8jj\" (UID: \"8009cf55-e775-4149-b7ba-0033f1951ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj"
Jul 24 18:45:37.211965 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:37.211928    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm" event={"ID":"c0cfb807-0130-4b06-8cbc-b769b5b6a49c","Type":"ContainerStarted","Data":"c2686924143e664f25e206f5bc31aab42e4da0f80ac07097edc505a4c73a3515"}
Jul 24 18:45:37.357977 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:37.357934    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj"
Jul 24 18:45:37.500408 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:37.500311    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ct8jj"]
Jul 24 18:45:37.503365 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:45:37.503330    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8009cf55_e775_4149_b7ba_0033f1951ad8.slice/crio-5ad7929fcbfa02da25efa7c8e439d88a735c024892a799566f04f761df84c664 WatchSource:0}: Error finding container 5ad7929fcbfa02da25efa7c8e439d88a735c024892a799566f04f761df84c664: Status 404 returned error can't find the container with id 5ad7929fcbfa02da25efa7c8e439d88a735c024892a799566f04f761df84c664
Jul 24 18:45:38.220310 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:38.220265    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj" event={"ID":"8009cf55-e775-4149-b7ba-0033f1951ad8","Type":"ContainerStarted","Data":"5ad7929fcbfa02da25efa7c8e439d88a735c024892a799566f04f761df84c664"}
Jul 24 18:45:40.232157 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:40.232115    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm" event={"ID":"c0cfb807-0130-4b06-8cbc-b769b5b6a49c","Type":"ContainerStarted","Data":"0dcd202f6a3c70cfbc38f30a1420b8f91c97be4873b604de8fa1a06726d743c8"}
Jul 24 18:45:40.232666 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:40.232293    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm"
Jul 24 18:45:40.233715 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:40.233689    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj" event={"ID":"8009cf55-e775-4149-b7ba-0033f1951ad8","Type":"ContainerStarted","Data":"03edd44a260c455df7349c05fe6ef472f6468ae0eae662decb3faf6db72efbca"}
Jul 24 18:45:40.233828 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:40.233736    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj"
Jul 24 18:45:40.250567 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:40.250522    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm" podStartSLOduration=2.108889535 podStartE2EDuration="5.250506348s" totalImagesPullingTime="3.141616813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:40.249025421 +0000 UTC m=+328.173978015" watchObservedRunningTime="2026-07-24 18:45:40.250506348 +0000 UTC m=+328.175458919"
Jul 24 18:45:40.267087 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:40.267035    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj" podStartSLOduration=1.863904963 podStartE2EDuration="4.267018213s" totalImagesPullingTime="2.40311325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:40.265754367 +0000 UTC m=+328.190706961" watchObservedRunningTime="2026-07-24 18:45:40.267018213 +0000 UTC m=+328.191970807"
Jul 24 18:45:45.230299 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.230256    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:45.324496 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.324453    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"]
Jul 24 18:45:45.327966 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.327933    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"]
Jul 24 18:45:45.328148 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.328068    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"
Jul 24 18:45:45.331020 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.330992    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 24 18:45:45.331183 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.331080    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8kf5m\""
Jul 24 18:45:45.331647 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.331612    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"
Jul 24 18:45:45.334627 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.334605    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 24 18:45:45.334910 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.334883    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2fbrt\""
Jul 24 18:45:45.345284 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.345249    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"]
Jul 24 18:45:45.356235 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.356195    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"]
Jul 24 18:45:45.358455 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.358417    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:45.416518 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.416479    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03b3db37-bd43-409a-ace0-8f83bfcc9e17-cert\") pod \"kserve-controller-manager-d6f4b65b8-gt6qt\" (UID: \"03b3db37-bd43-409a-ace0-8f83bfcc9e17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"
Jul 24 18:45:45.416743 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.416527    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/479b93f7-6bbf-4e3b-b4da-c12eda03937b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5jvqv\" (UID: \"479b93f7-6bbf-4e3b-b4da-c12eda03937b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"
Jul 24 18:45:45.416743 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.416556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtf5v\" (UniqueName: \"kubernetes.io/projected/03b3db37-bd43-409a-ace0-8f83bfcc9e17-kube-api-access-rtf5v\") pod \"kserve-controller-manager-d6f4b65b8-gt6qt\" (UID: \"03b3db37-bd43-409a-ace0-8f83bfcc9e17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"
Jul 24 18:45:45.416743 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.416650    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cstx9\" (UniqueName: \"kubernetes.io/projected/479b93f7-6bbf-4e3b-b4da-c12eda03937b-kube-api-access-cstx9\") pod \"llmisvc-controller-manager-777c6bd7d5-5jvqv\" (UID: \"479b93f7-6bbf-4e3b-b4da-c12eda03937b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"
Jul 24 18:45:45.517972 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.517865    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cstx9\" (UniqueName: \"kubernetes.io/projected/479b93f7-6bbf-4e3b-b4da-c12eda03937b-kube-api-access-cstx9\") pod \"llmisvc-controller-manager-777c6bd7d5-5jvqv\" (UID: \"479b93f7-6bbf-4e3b-b4da-c12eda03937b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"
Jul 24 18:45:45.517972 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.517957    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03b3db37-bd43-409a-ace0-8f83bfcc9e17-cert\") pod \"kserve-controller-manager-d6f4b65b8-gt6qt\" (UID: \"03b3db37-bd43-409a-ace0-8f83bfcc9e17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"
Jul 24 18:45:45.518195 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.517994    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/479b93f7-6bbf-4e3b-b4da-c12eda03937b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5jvqv\" (UID: \"479b93f7-6bbf-4e3b-b4da-c12eda03937b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"
Jul 24 18:45:45.518195 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.518025    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtf5v\" (UniqueName: \"kubernetes.io/projected/03b3db37-bd43-409a-ace0-8f83bfcc9e17-kube-api-access-rtf5v\") pod \"kserve-controller-manager-d6f4b65b8-gt6qt\" (UID: \"03b3db37-bd43-409a-ace0-8f83bfcc9e17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"
Jul 24 18:45:45.518195 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:45:45.518109    2557 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 24 18:45:45.518195 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:45:45.518181    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/479b93f7-6bbf-4e3b-b4da-c12eda03937b-cert podName:479b93f7-6bbf-4e3b-b4da-c12eda03937b nodeName:}" failed. No retries permitted until 2026-07-24 18:45:46.018164525 +0000 UTC m=+333.943117096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/479b93f7-6bbf-4e3b-b4da-c12eda03937b-cert") pod "llmisvc-controller-manager-777c6bd7d5-5jvqv" (UID: "479b93f7-6bbf-4e3b-b4da-c12eda03937b") : secret "llmisvc-webhook-server-cert" not found
Jul 24 18:45:45.518418 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:45:45.518114    2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 24 18:45:45.518418 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:45:45.518292    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03b3db37-bd43-409a-ace0-8f83bfcc9e17-cert podName:03b3db37-bd43-409a-ace0-8f83bfcc9e17 nodeName:}" failed. No retries permitted until 2026-07-24 18:45:46.018269909 +0000 UTC m=+333.943222491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/03b3db37-bd43-409a-ace0-8f83bfcc9e17-cert") pod "kserve-controller-manager-d6f4b65b8-gt6qt" (UID: "03b3db37-bd43-409a-ace0-8f83bfcc9e17") : secret "kserve-webhook-server-cert" not found
Jul 24 18:45:45.532558 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.532517    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cstx9\" (UniqueName: \"kubernetes.io/projected/479b93f7-6bbf-4e3b-b4da-c12eda03937b-kube-api-access-cstx9\") pod \"llmisvc-controller-manager-777c6bd7d5-5jvqv\" (UID: \"479b93f7-6bbf-4e3b-b4da-c12eda03937b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"
Jul 24 18:45:45.532693 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.532664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtf5v\" (UniqueName: \"kubernetes.io/projected/03b3db37-bd43-409a-ace0-8f83bfcc9e17-kube-api-access-rtf5v\") pod \"kserve-controller-manager-d6f4b65b8-gt6qt\" (UID: \"03b3db37-bd43-409a-ace0-8f83bfcc9e17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"
Jul 24 18:45:45.683015 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.682975    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:45.835933 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:45.835835    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:46.000977 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.000942    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:46.024098 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.024061    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03b3db37-bd43-409a-ace0-8f83bfcc9e17-cert\") pod \"kserve-controller-manager-d6f4b65b8-gt6qt\" (UID: \"03b3db37-bd43-409a-ace0-8f83bfcc9e17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"
Jul 24 18:45:46.024294 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.024105    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/479b93f7-6bbf-4e3b-b4da-c12eda03937b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5jvqv\" (UID: \"479b93f7-6bbf-4e3b-b4da-c12eda03937b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"
Jul 24 18:45:46.026669 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.026640    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/479b93f7-6bbf-4e3b-b4da-c12eda03937b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5jvqv\" (UID: \"479b93f7-6bbf-4e3b-b4da-c12eda03937b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"
Jul 24 18:45:46.026793 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.026646    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03b3db37-bd43-409a-ace0-8f83bfcc9e17-cert\") pod \"kserve-controller-manager-d6f4b65b8-gt6qt\" (UID: \"03b3db37-bd43-409a-ace0-8f83bfcc9e17\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"
Jul 24 18:45:46.050212 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.050180    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"]
Jul 24 18:45:46.053666 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.053643    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"
Jul 24 18:45:46.057513 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.057484    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 18:45:46.057641 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.057487    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 18:45:46.058036 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.058018    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 18:45:46.058230 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.058213    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tgqd5\""
Jul 24 18:45:46.058310 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.058217    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 18:45:46.072831 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.072805    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"]
Jul 24 18:45:46.226636 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.226596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl4rs\" (UniqueName: \"kubernetes.io/projected/05d5ed6c-ce16-4a91-b1fb-02b609d191c4-kube-api-access-zl4rs\") pod \"kube-auth-proxy-bbbd7cd9b-f6c88\" (UID: \"05d5ed6c-ce16-4a91-b1fb-02b609d191c4\") " pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"
Jul 24 18:45:46.226823 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.226644    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05d5ed6c-ce16-4a91-b1fb-02b609d191c4-tls-certs\") pod \"kube-auth-proxy-bbbd7cd9b-f6c88\" (UID: \"05d5ed6c-ce16-4a91-b1fb-02b609d191c4\") " pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"
Jul 24 18:45:46.226823 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.226718    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05d5ed6c-ce16-4a91-b1fb-02b609d191c4-tmp\") pod \"kube-auth-proxy-bbbd7cd9b-f6c88\" (UID: \"05d5ed6c-ce16-4a91-b1fb-02b609d191c4\") " pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"
Jul 24 18:45:46.242536 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.242501    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"
Jul 24 18:45:46.251704 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.251676    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"
Jul 24 18:45:46.290156 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.290116    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:46.328026 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.327975    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl4rs\" (UniqueName: \"kubernetes.io/projected/05d5ed6c-ce16-4a91-b1fb-02b609d191c4-kube-api-access-zl4rs\") pod \"kube-auth-proxy-bbbd7cd9b-f6c88\" (UID: \"05d5ed6c-ce16-4a91-b1fb-02b609d191c4\") " pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"
Jul 24 18:45:46.328213 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.328055    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05d5ed6c-ce16-4a91-b1fb-02b609d191c4-tls-certs\") pod \"kube-auth-proxy-bbbd7cd9b-f6c88\" (UID: \"05d5ed6c-ce16-4a91-b1fb-02b609d191c4\") " pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"
Jul 24 18:45:46.328213 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.328119    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05d5ed6c-ce16-4a91-b1fb-02b609d191c4-tmp\") pod \"kube-auth-proxy-bbbd7cd9b-f6c88\" (UID: \"05d5ed6c-ce16-4a91-b1fb-02b609d191c4\") " pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"
Jul 24 18:45:46.330864 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.330830    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05d5ed6c-ce16-4a91-b1fb-02b609d191c4-tmp\") pod \"kube-auth-proxy-bbbd7cd9b-f6c88\" (UID: \"05d5ed6c-ce16-4a91-b1fb-02b609d191c4\") " pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"
Jul 24 18:45:46.331009 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.330939    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05d5ed6c-ce16-4a91-b1fb-02b609d191c4-tls-certs\") pod \"kube-auth-proxy-bbbd7cd9b-f6c88\" (UID: \"05d5ed6c-ce16-4a91-b1fb-02b609d191c4\") " pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"
Jul 24 18:45:46.342982 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.342903    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl4rs\" (UniqueName: \"kubernetes.io/projected/05d5ed6c-ce16-4a91-b1fb-02b609d191c4-kube-api-access-zl4rs\") pod \"kube-auth-proxy-bbbd7cd9b-f6c88\" (UID: \"05d5ed6c-ce16-4a91-b1fb-02b609d191c4\") " pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"
Jul 24 18:45:46.363769 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.363736    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"
Jul 24 18:45:46.402153 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.402114    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"]
Jul 24 18:45:46.404480 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:45:46.404446    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b3db37_bd43_409a_ace0_8f83bfcc9e17.slice/crio-5474d804778830ae73a9c07e31c0a3cd34a42616046f6e1706bc24692c5f94f5 WatchSource:0}: Error finding container 5474d804778830ae73a9c07e31c0a3cd34a42616046f6e1706bc24692c5f94f5: Status 404 returned error can't find the container with id 5474d804778830ae73a9c07e31c0a3cd34a42616046f6e1706bc24692c5f94f5
Jul 24 18:45:46.420151 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.420067    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"]
Jul 24 18:45:46.424163 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:45:46.424119    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod479b93f7_6bbf_4e3b_b4da_c12eda03937b.slice/crio-20b13d1b35a21d369829ef777b7677e354f902c078ac6ebb2cc3afaa7167177d WatchSource:0}: Error finding container 20b13d1b35a21d369829ef777b7677e354f902c078ac6ebb2cc3afaa7167177d: Status 404 returned error can't find the container with id 20b13d1b35a21d369829ef777b7677e354f902c078ac6ebb2cc3afaa7167177d
Jul 24 18:45:46.520886 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.520855    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88"]
Jul 24 18:45:46.523669 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:45:46.523634    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d5ed6c_ce16_4a91_b1fb_02b609d191c4.slice/crio-be22e041de89c513646f1502f15360f5ec6427079e21ee23d3780c61d81398da WatchSource:0}: Error finding container be22e041de89c513646f1502f15360f5ec6427079e21ee23d3780c61d81398da: Status 404 returned error can't find the container with id be22e041de89c513646f1502f15360f5ec6427079e21ee23d3780c61d81398da
Jul 24 18:45:46.555750 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.555725    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:46.654756 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.654718    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:46.764783 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:46.764751    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:47.267667 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:47.267588    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88" event={"ID":"05d5ed6c-ce16-4a91-b1fb-02b609d191c4","Type":"ContainerStarted","Data":"be22e041de89c513646f1502f15360f5ec6427079e21ee23d3780c61d81398da"}
Jul 24 18:45:47.269353 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:47.269323    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv" event={"ID":"479b93f7-6bbf-4e3b-b4da-c12eda03937b","Type":"ContainerStarted","Data":"20b13d1b35a21d369829ef777b7677e354f902c078ac6ebb2cc3afaa7167177d"}
Jul 24 18:45:47.270890 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:47.270854    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt" event={"ID":"03b3db37-bd43-409a-ace0-8f83bfcc9e17","Type":"ContainerStarted","Data":"5474d804778830ae73a9c07e31c0a3cd34a42616046f6e1706bc24692c5f94f5"}
Jul 24 18:45:48.130114 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.130017    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:48.193895 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.193852    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"]
Jul 24 18:45:48.198727 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.198689    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.214006 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.213979    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 18:45:48.214229 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.214098    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 18:45:48.216506 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.216481    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 18:45:48.216695 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.216675    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-64ll2\""
Jul 24 18:45:48.216773 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.216762    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 18:45:48.246236 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.245704    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"]
Jul 24 18:45:48.265334 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.265301    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:48.349277 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.349213    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e831d732-d63f-402d-8674-958bb2e2d14c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.349737 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.349292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e831d732-d63f-402d-8674-958bb2e2d14c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.349737 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.349342    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ch58\" (UniqueName: \"kubernetes.io/projected/e831d732-d63f-402d-8674-958bb2e2d14c-kube-api-access-2ch58\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.349737 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.349444    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e831d732-d63f-402d-8674-958bb2e2d14c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.349737 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.349513    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e831d732-d63f-402d-8674-958bb2e2d14c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.349737 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.349546    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e831d732-d63f-402d-8674-958bb2e2d14c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.349737 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.349582    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e831d732-d63f-402d-8674-958bb2e2d14c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.450993 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.450884    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ch58\" (UniqueName: \"kubernetes.io/projected/e831d732-d63f-402d-8674-958bb2e2d14c-kube-api-access-2ch58\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.450993 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.450960    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e831d732-d63f-402d-8674-958bb2e2d14c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.451225 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.451014    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e831d732-d63f-402d-8674-958bb2e2d14c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.451225 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.451040    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e831d732-d63f-402d-8674-958bb2e2d14c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.451225 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.451070    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e831d732-d63f-402d-8674-958bb2e2d14c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.451225 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.451136    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e831d732-d63f-402d-8674-958bb2e2d14c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.451225 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.451175    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e831d732-d63f-402d-8674-958bb2e2d14c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.453028 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.452998    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e831d732-d63f-402d-8674-958bb2e2d14c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.455412 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.455363    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e831d732-d63f-402d-8674-958bb2e2d14c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.455540 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.455470    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e831d732-d63f-402d-8674-958bb2e2d14c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.455540 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.455479    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e831d732-d63f-402d-8674-958bb2e2d14c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.458400 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.457962    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e831d732-d63f-402d-8674-958bb2e2d14c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.462615 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.462552    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e831d732-d63f-402d-8674-958bb2e2d14c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.463045 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.463018    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ch58\" (UniqueName: \"kubernetes.io/projected/e831d732-d63f-402d-8674-958bb2e2d14c-kube-api-access-2ch58\") pod \"istiod-openshift-gateway-5677ccb49b-bb958\" (UID: \"e831d732-d63f-402d-8674-958bb2e2d14c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:48.513483 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:48.513447    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:49.420725 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:49.420689    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:50.294692 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:50.294645    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"
Jul 24 18:45:50.313292 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:50.313213    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt" podStartSLOduration=1.5370322779999999 podStartE2EDuration="5.31318786s" totalImagesPullingTime="3.776155582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:50.311515602 +0000 UTC m=+338.236468207" watchObservedRunningTime="2026-07-24 18:45:50.31318786 +0000 UTC m=+338.238140456"
Jul 24 18:45:50.335328 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:50.335309    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"]
Jul 24 18:45:50.337451 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:45:50.337415    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode831d732_d63f_402d_8674_958bb2e2d14c.slice/crio-ee19a68e74080ce2f68eda37c70357abe8f57c1447777008a192a21efaaed8f4 WatchSource:0}: Error finding container ee19a68e74080ce2f68eda37c70357abe8f57c1447777008a192a21efaaed8f4: Status 404 returned error can't find the container with id ee19a68e74080ce2f68eda37c70357abe8f57c1447777008a192a21efaaed8f4
Jul 24 18:45:51.240360 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:51.240330    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-rd4zm"
Jul 24 18:45:51.242298 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:51.242273    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ct8jj"
Jul 24 18:45:51.303883 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:51.303819    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv" event={"ID":"479b93f7-6bbf-4e3b-b4da-c12eda03937b","Type":"ContainerStarted","Data":"ef2ff0a6cabdd1d1c02381bf98609e1373cdbb95e30c8a5fcf0e99c1ba512551"}
Jul 24 18:45:51.304141 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:51.304119    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"
Jul 24 18:45:51.306889 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:51.306859    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt" event={"ID":"03b3db37-bd43-409a-ace0-8f83bfcc9e17","Type":"ContainerStarted","Data":"56db38db5225d618d2ed07346fa115d5bbd6134e22999b3e739a91f18be0fc65"}
Jul 24 18:45:51.309396 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:51.309337    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88" event={"ID":"05d5ed6c-ce16-4a91-b1fb-02b609d191c4","Type":"ContainerStarted","Data":"08481cce48e4a4aff8da41e9e9e830423e908524c075399c70903e9b3f84a3a7"}
Jul 24 18:45:51.311133 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:51.311101    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958" event={"ID":"e831d732-d63f-402d-8674-958bb2e2d14c","Type":"ContainerStarted","Data":"ee19a68e74080ce2f68eda37c70357abe8f57c1447777008a192a21efaaed8f4"}
Jul 24 18:45:51.339282 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:51.339219    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-bbbd7cd9b-f6c88" podStartSLOduration=1.674311994 podStartE2EDuration="5.33920152s" totalImagesPullingTime="3.664889526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:51.337440183 +0000 UTC m=+339.262392781" watchObservedRunningTime="2026-07-24 18:45:51.33920152 +0000 UTC m=+339.264154114"
Jul 24 18:45:51.340548 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:51.340492    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv" podStartSLOduration=2.583425383 podStartE2EDuration="6.340471644s" totalImagesPullingTime="3.757046261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:51.320285183 +0000 UTC m=+339.245237778" watchObservedRunningTime="2026-07-24 18:45:51.340471644 +0000 UTC m=+339.265424239"
Jul 24 18:45:53.409413 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:53.409350    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:45:53.409731 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:53.409475    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:45:54.129756 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:54.129712    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:54.231007 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:54.230961    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:54.328414 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:54.328362    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958" event={"ID":"e831d732-d63f-402d-8674-958bb2e2d14c","Type":"ContainerStarted","Data":"f6eb21b28ee64c839f3b1d669fad273e90e50763695752f7c8b70ee81d39f72a"}
Jul 24 18:45:54.328611 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:54.328559    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:54.330263 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:54.330234    2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-bb958 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 18:45:54.330405 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:54.330291    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958" podUID="e831d732-d63f-402d-8674-958bb2e2d14c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 18:45:54.354460 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:54.354395    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958" podStartSLOduration=3.284780597 podStartE2EDuration="6.354358222s" totalImagesPullingTime="3.069577625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:54.351723938 +0000 UTC m=+342.276676535" watchObservedRunningTime="2026-07-24 18:45:54.354358222 +0000 UTC m=+342.279310816"
Jul 24 18:45:54.813012 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:54.812975    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:54.969604 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:54.969567    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:55.071417 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:55.071299    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:55.333667 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:55.333577    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bb958"
Jul 24 18:45:58.017676 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:45:58.017636    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:22.318274 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:46:22.318240    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5jvqv"
Jul 24 18:46:22.321132 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:46:22.321109    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gt6qt"
Jul 24 18:46:36.151774 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:46:36.151737    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:36.248973 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:46:36.248943    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:36.336298 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:46:36.336261    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:37.079956 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:46:37.079923    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:37.285110 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:46:37.285064    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:47.524107 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:46:47.524067    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:47.579985 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:46:47.579944    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:49.475843 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:46:49.475805    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:49.537138 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:46:49.537100    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:00.306511 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:00.306467    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:05.045711 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:05.045674    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:06.858246 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:06.858202    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dd9ffb44b-lmldv"]
Jul 24 18:47:06.860682 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:06.860662    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:06.874185 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:06.874159    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd9ffb44b-lmldv"]
Jul 24 18:47:06.920887 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:06.920824    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:06.942082 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:06.942047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-console-config\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:06.942208 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:06.942120    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98tdt\" (UniqueName: \"kubernetes.io/projected/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-kube-api-access-98tdt\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:06.942208 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:06.942160    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-trusted-ca-bundle\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:06.942208 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:06.942187    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-service-ca\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:06.942340 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:06.942226    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-console-oauth-config\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:06.942340 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:06.942247    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-console-serving-cert\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:06.942340 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:06.942270    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-oauth-serving-cert\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:06.984567 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:06.984523    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:07.042705 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.042671    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-service-ca\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.042868 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.042713    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-console-oauth-config\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.042868 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.042741    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-console-serving-cert\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.042868 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.042759    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-oauth-serving-cert\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.042868 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.042784    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-console-config\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.042868 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.042836    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98tdt\" (UniqueName: \"kubernetes.io/projected/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-kube-api-access-98tdt\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.043119 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.042874    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-trusted-ca-bundle\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.043608 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.043579    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-service-ca\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.043738 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.043586    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-oauth-serving-cert\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.043738 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.043642    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-console-config\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.043864 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.043741    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-trusted-ca-bundle\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.045341 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.045322    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-console-serving-cert\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.045436 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.045352    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-console-oauth-config\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.051029 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.051011    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98tdt\" (UniqueName: \"kubernetes.io/projected/bc4ca0a7-5d95-43f3-9b11-c39fecb9040a-kube-api-access-98tdt\") pod \"console-dd9ffb44b-lmldv\" (UID: \"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a\") " pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.170310 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.170212    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:07.302609 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.302585    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd9ffb44b-lmldv"]
Jul 24 18:47:07.305056 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:47:07.305027    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4ca0a7_5d95_43f3_9b11_c39fecb9040a.slice/crio-e4694f437f9111d4d4b54e86652a3f2f33c8c2ff1fb869b4aadbc25647b46023 WatchSource:0}: Error finding container e4694f437f9111d4d4b54e86652a3f2f33c8c2ff1fb869b4aadbc25647b46023: Status 404 returned error can't find the container with id e4694f437f9111d4d4b54e86652a3f2f33c8c2ff1fb869b4aadbc25647b46023
Jul 24 18:47:07.655930 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.655893    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd9ffb44b-lmldv" event={"ID":"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a","Type":"ContainerStarted","Data":"a10232c4e9cff0df2a096fda7b4069485336a22618c69097fd6e74037a4bf9ad"}
Jul 24 18:47:07.656115 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:07.655941    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd9ffb44b-lmldv" event={"ID":"bc4ca0a7-5d95-43f3-9b11-c39fecb9040a","Type":"ContainerStarted","Data":"e4694f437f9111d4d4b54e86652a3f2f33c8c2ff1fb869b4aadbc25647b46023"}
Jul 24 18:47:08.421503 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:08.421469    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:09.719893 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:09.719835    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:13.292999 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:13.292968    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:13.452666 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:13.452630    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:15.321358 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:15.321317    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:15.623616 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:15.623505    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dd9ffb44b-lmldv" podStartSLOduration=9.623486072 podStartE2EDuration="9.623486072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:47:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:47:07.689272468 +0000 UTC m=+415.614225061" watchObservedRunningTime="2026-07-24 18:47:15.623486072 +0000 UTC m=+423.548438665"
Jul 24 18:47:15.624719 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:15.624699    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"]
Jul 24 18:47:15.628470 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:15.628450    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:15.632875 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:15.632851    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 18:47:15.633003 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:15.632851    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 18:47:15.633003 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:15.632920    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9dzjf\""
Jul 24 18:47:15.638165 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:15.638142    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"]
Jul 24 18:47:15.728869 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:15.728834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpwxc\" (UniqueName: \"kubernetes.io/projected/98a281c3-4148-41fb-a38c-47dec8627dbd-kube-api-access-lpwxc\") pod \"limitador-operator-controller-manager-859d7b78bd-szn8h\" (UID: \"98a281c3-4148-41fb-a38c-47dec8627dbd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:15.830024 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:15.829992    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpwxc\" (UniqueName: \"kubernetes.io/projected/98a281c3-4148-41fb-a38c-47dec8627dbd-kube-api-access-lpwxc\") pod \"limitador-operator-controller-manager-859d7b78bd-szn8h\" (UID: \"98a281c3-4148-41fb-a38c-47dec8627dbd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:15.840702 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:15.840667    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpwxc\" (UniqueName: \"kubernetes.io/projected/98a281c3-4148-41fb-a38c-47dec8627dbd-kube-api-access-lpwxc\") pod \"limitador-operator-controller-manager-859d7b78bd-szn8h\" (UID: \"98a281c3-4148-41fb-a38c-47dec8627dbd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:15.939067 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:15.938971    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:16.074895 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:16.074863    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"]
Jul 24 18:47:16.076685 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:47:16.076649    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a281c3_4148_41fb_a38c_47dec8627dbd.slice/crio-6096c9726a75c8ffaf9b1223604febb41ed25d5f33615a3663d76f022a7a1b12 WatchSource:0}: Error finding container 6096c9726a75c8ffaf9b1223604febb41ed25d5f33615a3663d76f022a7a1b12: Status 404 returned error can't find the container with id 6096c9726a75c8ffaf9b1223604febb41ed25d5f33615a3663d76f022a7a1b12
Jul 24 18:47:16.235118 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:16.235082    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:16.512054 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:16.511970    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:16.705860 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:16.705825    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h" event={"ID":"98a281c3-4148-41fb-a38c-47dec8627dbd","Type":"ContainerStarted","Data":"6096c9726a75c8ffaf9b1223604febb41ed25d5f33615a3663d76f022a7a1b12"}
Jul 24 18:47:17.170944 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:17.170910    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:17.171120 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:17.170979    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:17.176535 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:17.176508    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:17.715646 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:17.715612    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dd9ffb44b-lmldv"
Jul 24 18:47:17.768008 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:17.767969    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d6cfc7488-cmfqn"]
Jul 24 18:47:17.892765 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:17.892715    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:17.986552 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:17.986458    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:18.109675 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:18.109634    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:18.217590 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:18.217559    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:18.545039 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:18.544993    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:18.717222 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:18.717189    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h" event={"ID":"98a281c3-4148-41fb-a38c-47dec8627dbd","Type":"ContainerStarted","Data":"d7268b5b9a2cc2d29dcd8ee99672ab711068bf2dc89ba479b83916450f6db60c"}
Jul 24 18:47:18.717634 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:18.717268    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:18.735126 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:18.734993    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h" podStartSLOduration=1.9446486969999999 podStartE2EDuration="3.734973138s" totalImagesPullingTime="1.790324441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:47:18.734470115 +0000 UTC m=+426.659422756" watchObservedRunningTime="2026-07-24 18:47:18.734973138 +0000 UTC m=+426.659925732"
Jul 24 18:47:21.454523 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:21.454477    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:21.581097 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:21.581068    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:26.893096 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:26.893035    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:26.997534 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:26.997490    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:27.239255 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:27.239219    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:27.376269 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:27.376240    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:29.062295 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:29.062262    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:29.577142 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:29.577107    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:29.724831 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:29.724804    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:30.647033 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:30.646997    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:30.751618 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:30.751580    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:33.185588 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:33.185549    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:33.284790 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:33.284753    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:39.117796 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.117712    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"]
Jul 24 18:47:39.118336 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.117918    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h" podUID="98a281c3-4148-41fb-a38c-47dec8627dbd" containerName="manager" containerID="cri-o://d7268b5b9a2cc2d29dcd8ee99672ab711068bf2dc89ba479b83916450f6db60c" gracePeriod=2
Jul 24 18:47:39.132576 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.132546    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"]
Jul 24 18:47:39.147004 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.146972    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z"]
Jul 24 18:47:39.147360 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.147343    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98a281c3-4148-41fb-a38c-47dec8627dbd" containerName="manager"
Jul 24 18:47:39.147474 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.147361    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="98a281c3-4148-41fb-a38c-47dec8627dbd" containerName="manager"
Jul 24 18:47:39.147531 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.147475    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="98a281c3-4148-41fb-a38c-47dec8627dbd" containerName="manager"
Jul 24 18:47:39.150958 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.150933    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z"
Jul 24 18:47:39.154895 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:47:39.154810    2557 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"98a281c3-4148-41fb-a38c-47dec8627dbd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-szn8h\": pods \"limitador-operator-controller-manager-859d7b78bd-szn8h\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:39.160673 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.160643    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z"]
Jul 24 18:47:39.180642 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:47:39.180598    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-szn8h\" is forbidden: User \"system:node:ip-10-0-141-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-149.ec2.internal' and this object" podUID="98a281c3-4148-41fb-a38c-47dec8627dbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:39.229205 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.229168    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdnxj\" (UniqueName: \"kubernetes.io/projected/8eb25bec-7c4a-4a45-9246-62236e6fdb8d-kube-api-access-tdnxj\") pod \"limitador-operator-controller-manager-859d7b78bd-k2j8z\" (UID: \"8eb25bec-7c4a-4a45-9246-62236e6fdb8d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z"
Jul 24 18:47:39.330549 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.330502    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdnxj\" (UniqueName: \"kubernetes.io/projected/8eb25bec-7c4a-4a45-9246-62236e6fdb8d-kube-api-access-tdnxj\") pod \"limitador-operator-controller-manager-859d7b78bd-k2j8z\" (UID: \"8eb25bec-7c4a-4a45-9246-62236e6fdb8d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z"
Jul 24 18:47:39.339566 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.339535    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdnxj\" (UniqueName: \"kubernetes.io/projected/8eb25bec-7c4a-4a45-9246-62236e6fdb8d-kube-api-access-tdnxj\") pod \"limitador-operator-controller-manager-859d7b78bd-k2j8z\" (UID: \"8eb25bec-7c4a-4a45-9246-62236e6fdb8d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z"
Jul 24 18:47:39.360439 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.360419    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:39.363276 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:47:39.363250    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-szn8h\" is forbidden: User \"system:node:ip-10-0-141-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-149.ec2.internal' and this object" podUID="98a281c3-4148-41fb-a38c-47dec8627dbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:39.431031 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.430950    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpwxc\" (UniqueName: \"kubernetes.io/projected/98a281c3-4148-41fb-a38c-47dec8627dbd-kube-api-access-lpwxc\") pod \"98a281c3-4148-41fb-a38c-47dec8627dbd\" (UID: \"98a281c3-4148-41fb-a38c-47dec8627dbd\") "
Jul 24 18:47:39.433026 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.433005    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98a281c3-4148-41fb-a38c-47dec8627dbd-kube-api-access-lpwxc" (OuterVolumeSpecName: "kube-api-access-lpwxc") pod "98a281c3-4148-41fb-a38c-47dec8627dbd" (UID: "98a281c3-4148-41fb-a38c-47dec8627dbd"). InnerVolumeSpecName "kube-api-access-lpwxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:47:39.496987 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.496950    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z"
Jul 24 18:47:39.532290 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.532254    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpwxc\" (UniqueName: \"kubernetes.io/projected/98a281c3-4148-41fb-a38c-47dec8627dbd-kube-api-access-lpwxc\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:47:39.647604 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.647565    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z"]
Jul 24 18:47:39.655147 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:47:39.655104    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb25bec_7c4a_4a45_9246_62236e6fdb8d.slice/crio-249b2a0a78e45b9ce6efba647186ea6f00a1a029cdb9fd04c2b71ae408cf4bf7 WatchSource:0}: Error finding container 249b2a0a78e45b9ce6efba647186ea6f00a1a029cdb9fd04c2b71ae408cf4bf7: Status 404 returned error can't find the container with id 249b2a0a78e45b9ce6efba647186ea6f00a1a029cdb9fd04c2b71ae408cf4bf7
Jul 24 18:47:39.816527 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.816492    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z" event={"ID":"8eb25bec-7c4a-4a45-9246-62236e6fdb8d","Type":"ContainerStarted","Data":"b7daa53f415f111d8e2fc1d2073a84df51fa7bd72b37815f6d966c68f0bfcf73"}
Jul 24 18:47:39.816807 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.816551    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z" event={"ID":"8eb25bec-7c4a-4a45-9246-62236e6fdb8d","Type":"ContainerStarted","Data":"249b2a0a78e45b9ce6efba647186ea6f00a1a029cdb9fd04c2b71ae408cf4bf7"}
Jul 24 18:47:39.816807 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.816596    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z"
Jul 24 18:47:39.817817 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.817791    2557 generic.go:356] "Generic (PLEG): container finished" podID="98a281c3-4148-41fb-a38c-47dec8627dbd" containerID="d7268b5b9a2cc2d29dcd8ee99672ab711068bf2dc89ba479b83916450f6db60c" exitCode=0
Jul 24 18:47:39.817949 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.817856    2557 scope.go:117] "RemoveContainer" containerID="d7268b5b9a2cc2d29dcd8ee99672ab711068bf2dc89ba479b83916450f6db60c"
Jul 24 18:47:39.817949 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.817886    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:39.827081 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.827062    2557 scope.go:117] "RemoveContainer" containerID="d7268b5b9a2cc2d29dcd8ee99672ab711068bf2dc89ba479b83916450f6db60c"
Jul 24 18:47:39.827336 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:47:39.827318    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7268b5b9a2cc2d29dcd8ee99672ab711068bf2dc89ba479b83916450f6db60c\": container with ID starting with d7268b5b9a2cc2d29dcd8ee99672ab711068bf2dc89ba479b83916450f6db60c not found: ID does not exist" containerID="d7268b5b9a2cc2d29dcd8ee99672ab711068bf2dc89ba479b83916450f6db60c"
Jul 24 18:47:39.827398 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.827344    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7268b5b9a2cc2d29dcd8ee99672ab711068bf2dc89ba479b83916450f6db60c"} err="failed to get container status \"d7268b5b9a2cc2d29dcd8ee99672ab711068bf2dc89ba479b83916450f6db60c\": rpc error: code = NotFound desc = could not find container \"d7268b5b9a2cc2d29dcd8ee99672ab711068bf2dc89ba479b83916450f6db60c\": container with ID starting with d7268b5b9a2cc2d29dcd8ee99672ab711068bf2dc89ba479b83916450f6db60c not found: ID does not exist"
Jul 24 18:47:39.843198 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.843156    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z" podStartSLOduration=0.843143109 podStartE2EDuration="843.143109ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:47:39.8412137 +0000 UTC m=+447.766166306" watchObservedRunningTime="2026-07-24 18:47:39.843143109 +0000 UTC m=+447.768095703"
Jul 24 18:47:39.843517 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:47:39.843494    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-szn8h\" is forbidden: User \"system:node:ip-10-0-141-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-149.ec2.internal' and this object" podUID="98a281c3-4148-41fb-a38c-47dec8627dbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:39.845612 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:47:39.845588    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-szn8h\" is forbidden: User \"system:node:ip-10-0-141-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-149.ec2.internal' and this object" podUID="98a281c3-4148-41fb-a38c-47dec8627dbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-szn8h"
Jul 24 18:47:39.854764 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.854711    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:39.940587 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:39.940556    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:40.621134 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:40.621092    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98a281c3-4148-41fb-a38c-47dec8627dbd" path="/var/lib/kubelet/pods/98a281c3-4148-41fb-a38c-47dec8627dbd/volumes"
Jul 24 18:47:42.791838 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:42.791763    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d6cfc7488-cmfqn" podUID="21092633-e269-4e1e-98f0-01854b71d4bc" containerName="console" containerID="cri-o://7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e" gracePeriod=15
Jul 24 18:47:43.040479 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.040452    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:47:43.065648 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.065549    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsdgt\" (UniqueName: \"kubernetes.io/projected/21092633-e269-4e1e-98f0-01854b71d4bc-kube-api-access-nsdgt\") pod \"21092633-e269-4e1e-98f0-01854b71d4bc\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") "
Jul 24 18:47:43.065648 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.065587    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-oauth-serving-cert\") pod \"21092633-e269-4e1e-98f0-01854b71d4bc\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") "
Jul 24 18:47:43.065648 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.065625    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-service-ca\") pod \"21092633-e269-4e1e-98f0-01854b71d4bc\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") "
Jul 24 18:47:43.065926 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.065660    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-console-config\") pod \"21092633-e269-4e1e-98f0-01854b71d4bc\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") "
Jul 24 18:47:43.065926 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.065676    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21092633-e269-4e1e-98f0-01854b71d4bc-console-oauth-config\") pod \"21092633-e269-4e1e-98f0-01854b71d4bc\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") "
Jul 24 18:47:43.065926 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.065721    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21092633-e269-4e1e-98f0-01854b71d4bc-console-serving-cert\") pod \"21092633-e269-4e1e-98f0-01854b71d4bc\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") "
Jul 24 18:47:43.065926 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.065749    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-trusted-ca-bundle\") pod \"21092633-e269-4e1e-98f0-01854b71d4bc\" (UID: \"21092633-e269-4e1e-98f0-01854b71d4bc\") "
Jul 24 18:47:43.066361 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.066329    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-console-config" (OuterVolumeSpecName: "console-config") pod "21092633-e269-4e1e-98f0-01854b71d4bc" (UID: "21092633-e269-4e1e-98f0-01854b71d4bc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:47:43.066464 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.066408    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "21092633-e269-4e1e-98f0-01854b71d4bc" (UID: "21092633-e269-4e1e-98f0-01854b71d4bc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:47:43.066639 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.066603    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-service-ca" (OuterVolumeSpecName: "service-ca") pod "21092633-e269-4e1e-98f0-01854b71d4bc" (UID: "21092633-e269-4e1e-98f0-01854b71d4bc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:47:43.066706 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.066643    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-oauth-serving-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:47:43.066706 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.066681    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-console-config\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:47:43.068411 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.067098    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "21092633-e269-4e1e-98f0-01854b71d4bc" (UID: "21092633-e269-4e1e-98f0-01854b71d4bc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:47:43.070350 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.070308    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21092633-e269-4e1e-98f0-01854b71d4bc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "21092633-e269-4e1e-98f0-01854b71d4bc" (UID: "21092633-e269-4e1e-98f0-01854b71d4bc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:47:43.076859 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.076612    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21092633-e269-4e1e-98f0-01854b71d4bc-kube-api-access-nsdgt" (OuterVolumeSpecName: "kube-api-access-nsdgt") pod "21092633-e269-4e1e-98f0-01854b71d4bc" (UID: "21092633-e269-4e1e-98f0-01854b71d4bc"). InnerVolumeSpecName "kube-api-access-nsdgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:47:43.076859 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.076643    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21092633-e269-4e1e-98f0-01854b71d4bc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "21092633-e269-4e1e-98f0-01854b71d4bc" (UID: "21092633-e269-4e1e-98f0-01854b71d4bc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:47:43.167967 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.167928    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21092633-e269-4e1e-98f0-01854b71d4bc-console-serving-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:47:43.167967 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.167960    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-trusted-ca-bundle\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:47:43.168214 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.167994    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsdgt\" (UniqueName: \"kubernetes.io/projected/21092633-e269-4e1e-98f0-01854b71d4bc-kube-api-access-nsdgt\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:47:43.168214 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.168006    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21092633-e269-4e1e-98f0-01854b71d4bc-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:47:43.168214 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.168015    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21092633-e269-4e1e-98f0-01854b71d4bc-console-oauth-config\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 18:47:43.837615 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.837583    2557 generic.go:356] "Generic (PLEG): container finished" podID="21092633-e269-4e1e-98f0-01854b71d4bc" containerID="7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e" exitCode=0
Jul 24 18:47:43.838026 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.837642    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6cfc7488-cmfqn"
Jul 24 18:47:43.838026 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.837674    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6cfc7488-cmfqn" event={"ID":"21092633-e269-4e1e-98f0-01854b71d4bc","Type":"ContainerDied","Data":"7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e"}
Jul 24 18:47:43.838026 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.837728    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6cfc7488-cmfqn" event={"ID":"21092633-e269-4e1e-98f0-01854b71d4bc","Type":"ContainerDied","Data":"549cb12838a8fadfda77cbce9ddbca0bc4e95b5a87255996f2b6a68e71187635"}
Jul 24 18:47:43.838026 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.837755    2557 scope.go:117] "RemoveContainer" containerID="7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e"
Jul 24 18:47:43.847834 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.847815    2557 scope.go:117] "RemoveContainer" containerID="7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e"
Jul 24 18:47:43.848105 ip-10-0-141-149 kubenswrapper[2557]: E0724 18:47:43.848083    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e\": container with ID starting with 7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e not found: ID does not exist" containerID="7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e"
Jul 24 18:47:43.848157 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.848114    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e"} err="failed to get container status \"7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e\": rpc error: code = NotFound desc = could not find container \"7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e\": container with ID starting with 7efb04d7f28154dab32447787851d6bcad179fcfc7aca4363159754e9eb5289e not found: ID does not exist"
Jul 24 18:47:43.865572 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.865542    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d6cfc7488-cmfqn"]
Jul 24 18:47:43.869460 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:43.869439    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d6cfc7488-cmfqn"]
Jul 24 18:47:44.621662 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:44.621622    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21092633-e269-4e1e-98f0-01854b71d4bc" path="/var/lib/kubelet/pods/21092633-e269-4e1e-98f0-01854b71d4bc/volumes"
Jul 24 18:47:45.242099 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:45.242060    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:45.342117 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:45.342087    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:45.833980 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:45.833950    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:45.901776 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:45.901732    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:49.263567 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:49.263537    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:49.449692 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:49.449663    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:50.825602 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:50.825566    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k2j8z"
Jul 24 18:47:53.025474 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:53.025427    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:53.100263 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:47:53.100230    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:23.523215 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:23.523170    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:26.751011 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:26.750974    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:27.045834 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:27.045749    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:27.374339 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:27.374195    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:27.473684 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:27.473649    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:29.017506 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.017470    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:29.122365 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.122332    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:29.226925 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.226873    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:29.512709 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.512674    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:48:29.513016 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.513004    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21092633-e269-4e1e-98f0-01854b71d4bc" containerName="console"
Jul 24 18:48:29.513070 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.513018    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="21092633-e269-4e1e-98f0-01854b71d4bc" containerName="console"
Jul 24 18:48:29.513106 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.513085    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="21092633-e269-4e1e-98f0-01854b71d4bc" containerName="console"
Jul 24 18:48:29.517032 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.517008    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7"
Jul 24 18:48:29.520189 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.520165    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 18:48:29.520312 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.520224    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-49g7j\""
Jul 24 18:48:29.527815 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.527785    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:48:29.556212 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.556176    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:48:29.557640 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.557617    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c0a49ac0-4daa-4451-b83d-d50880227015-config-file\") pod \"limitador-limitador-54d6d988d5-9dht7\" (UID: \"c0a49ac0-4daa-4451-b83d-d50880227015\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7"
Jul 24 18:48:29.557725 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.557699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhb6h\" (UniqueName: \"kubernetes.io/projected/c0a49ac0-4daa-4451-b83d-d50880227015-kube-api-access-fhb6h\") pod \"limitador-limitador-54d6d988d5-9dht7\" (UID: \"c0a49ac0-4daa-4451-b83d-d50880227015\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7"
Jul 24 18:48:29.658346 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.658307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhb6h\" (UniqueName: \"kubernetes.io/projected/c0a49ac0-4daa-4451-b83d-d50880227015-kube-api-access-fhb6h\") pod \"limitador-limitador-54d6d988d5-9dht7\" (UID: \"c0a49ac0-4daa-4451-b83d-d50880227015\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7"
Jul 24 18:48:29.658572 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.658390    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c0a49ac0-4daa-4451-b83d-d50880227015-config-file\") pod \"limitador-limitador-54d6d988d5-9dht7\" (UID: \"c0a49ac0-4daa-4451-b83d-d50880227015\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7"
Jul 24 18:48:29.659021 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.658999    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c0a49ac0-4daa-4451-b83d-d50880227015-config-file\") pod \"limitador-limitador-54d6d988d5-9dht7\" (UID: \"c0a49ac0-4daa-4451-b83d-d50880227015\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7"
Jul 24 18:48:29.673519 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.673490    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhb6h\" (UniqueName: \"kubernetes.io/projected/c0a49ac0-4daa-4451-b83d-d50880227015-kube-api-access-fhb6h\") pod \"limitador-limitador-54d6d988d5-9dht7\" (UID: \"c0a49ac0-4daa-4451-b83d-d50880227015\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7"
Jul 24 18:48:29.828956 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.828864    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7"
Jul 24 18:48:29.924242 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.924213    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:29.978089 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.978062    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:48:29.998296 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:29.998262    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:30.051224 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:30.051184    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7" event={"ID":"c0a49ac0-4daa-4451-b83d-d50880227015","Type":"ContainerStarted","Data":"8e14fc62492a2405f0aa18096716d0b0abfde485a6218cbab73bcf67301dbd7b"}
Jul 24 18:48:33.067548 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:33.067511    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7" event={"ID":"c0a49ac0-4daa-4451-b83d-d50880227015","Type":"ContainerStarted","Data":"51acae0a14c8f2be7bb0293bf6f84447afc3b9832335aaed26f1d8041bae2e75"}
Jul 24 18:48:33.067993 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:33.067659    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7"
Jul 24 18:48:33.089454 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:33.089364    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7" podStartSLOduration=1.614660549 podStartE2EDuration="4.089342742s" totalImagesPullingTime="2.474682193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:48:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:48:33.088862362 +0000 UTC m=+501.013814957" watchObservedRunningTime="2026-07-24 18:48:33.089342742 +0000 UTC m=+501.014295337"
Jul 24 18:48:44.075265 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:44.075233    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9dht7"
Jul 24 18:48:50.129344 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:50.129305    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:50.239615 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:50.239583    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:50.581140 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:48:50.581100    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:05.825938 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:05.825850    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:06.104559 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:06.104449    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:12.592044 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:12.592009    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:12.684501 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:12.684469    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:12.755849 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:12.755815    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:13.117391 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:13.117348    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:16.412927 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:16.412869    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:16.513454 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:16.513419    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:46.267660 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:46.267604    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:46.360937 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:46.360894    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:46.906537 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:46.906494    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:47.450449 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:47.450407    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:47.548860 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:47.548823    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:47.584786 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:47.584750    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:49:47.966911 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:47.966874    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:58.719714 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:58.719673    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:58.816036 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:49:58.816002    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:09.215887 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:50:09.215843    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:09.316903 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:50:09.316866    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:14.476369 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:50:14.476328    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:14.818313 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:50:14.818227    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:50:34.788272 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:50:34.788183    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:50.601662 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:50:50.601628    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:51.331936 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:50:51.331897    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:50:56.102618 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:50:56.102589    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:57.138450 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:50:57.138412    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:51:05.843640 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.843601    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"]
Jul 24 18:51:05.847189 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.847165    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:05.850665 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.850635    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pq4pw\""
Jul 24 18:51:05.850665 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.850653    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 24 18:51:05.850885 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.850747    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 18:51:05.850885 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.850771    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 18:51:05.857105 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.857078    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"]
Jul 24 18:51:05.888854 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.888821    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:05.943461 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.943427    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6sbp\" (UniqueName: \"kubernetes.io/projected/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-kube-api-access-w6sbp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:05.943636 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.943470    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:05.943636 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.943492    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:05.943636 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.943574    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:05.943636 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.943619    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:05.943767 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:05.943683    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.044740 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.044697    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.044913 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.044777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6sbp\" (UniqueName: \"kubernetes.io/projected/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-kube-api-access-w6sbp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.044913 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.044815    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.044913 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.044843    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.044913 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.044901    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.045116 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.044937    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.045355 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.045330    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.045355 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.045347    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.045513 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.045414    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.047124 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.047096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.047322 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.047305    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.053843 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.053810    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6sbp\" (UniqueName: \"kubernetes.io/projected/de13232d-f2b1-47ea-9b64-a0dcbcac5bfe-kube-api-access-w6sbp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd\" (UID: \"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.158518 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.158423    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:06.295772 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.295741    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"]
Jul 24 18:51:06.297687 ip-10-0-141-149 kubenswrapper[2557]: W0724 18:51:06.297656    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde13232d_f2b1_47ea_9b64_a0dcbcac5bfe.slice/crio-9b2748377d6f026d88171ecc8f47128290c6873fbea2a3258194edb69b66563f WatchSource:0}: Error finding container 9b2748377d6f026d88171ecc8f47128290c6873fbea2a3258194edb69b66563f: Status 404 returned error can't find the container with id 9b2748377d6f026d88171ecc8f47128290c6873fbea2a3258194edb69b66563f
Jul 24 18:51:06.299298 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.299275    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 18:51:06.778703 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:06.778662    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd" event={"ID":"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe","Type":"ContainerStarted","Data":"9b2748377d6f026d88171ecc8f47128290c6873fbea2a3258194edb69b66563f"}
Jul 24 18:51:07.439967 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:07.439927    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:51:07.785152 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:07.785114    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd" event={"ID":"de13232d-f2b1-47ea-9b64-a0dcbcac5bfe","Type":"ContainerStarted","Data":"a38820d2fe82d1b4f576cc7806306864ffd805bbcfe1d2fed1b3146e0247fb78"}
Jul 24 18:51:07.816099 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:07.816042    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd" podStartSLOduration=1.855990627 podStartE2EDuration="2.816022525s" totalImagesPullingTime="960.031898ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:51:07.815747186 +0000 UTC m=+655.740699781" watchObservedRunningTime="2026-07-24 18:51:07.816022525 +0000 UTC m=+655.740975118"
Jul 24 18:51:16.158894 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:16.158853    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:16.159311 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:16.158916    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:16.171305 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:16.171276    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:16.838272 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:16.838237    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd"
Jul 24 18:51:18.596214 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:18.596180    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:21.229251 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:21.229213    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:51:23.584360 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:23.584323    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:31.828732 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:31.828685    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:32.822047 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:32.822004    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:51:40.126721 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:40.126683    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:40.186905 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:51:40.186867    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:08.549648 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:52:08.549572    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:42.280935 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:52:42.280897    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:42.381803 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:52:42.381768    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:43.429829 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:52:43.429786    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:43.537580 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:52:43.537542    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:51.750095 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:52:51.750061    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:53:11.731103 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:53:11.731061    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:53:21.820175 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:53:21.820137    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:53:32.136612 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:53:32.136575    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:54:08.235388 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:54:08.235335    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:54:48.575515 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:54:48.575479    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:54:49.795128 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:54:49.795086    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:12.132344 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:55:12.132258    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:55:23.821513 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:55:23.821461    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:55:28.446880 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:55:28.446824    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:28.557481 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:55:28.557429    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:28.700618 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:55:28.700498    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:34.476637 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:55:34.476584    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:34.594076 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:55:34.594037    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:34.677948 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:55:34.677913    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:34.818418 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:55:34.818277    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:40.557850 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:55:40.557803    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:41.612632 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:55:41.612568    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:56.426510 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:55:56.426473    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:56:04.926644 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:56:04.926604    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:56:14.332566 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:56:14.332527    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:56:20.020132 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:56:20.020087    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:56:30.936081 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:56:30.936043    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:56:40.817978 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:56:40.817890    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:56:47.977149 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:56:47.977111    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:56:51.726175 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:56:51.726133    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:57:01.424677 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:57:01.424640    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:57:24.021992 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:57:24.021953    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:57:33.846828 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:57:33.846786    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:57:37.550608 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:57:37.550567    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 18:57:55.532776 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:57:55.532735    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:58:07.524039 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:58:07.523942    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:58:22.536586 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:58:22.536548    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:58:31.524405 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:58:31.524341    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:58:41.317132 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:58:41.317088    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:58:51.025615 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:58:51.025574    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 18:58:59.725792 ip-10-0-141-149 kubenswrapper[2557]: I0724 18:58:59.725735    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:00:49.938082 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:00:49.938046    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:01:02.128062 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:01:02.128022    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:01:11.221743 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:01:11.221666    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:01:25.726648 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:01:25.726597    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:01:35.340630 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:01:35.340592    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:01:44.720496 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:01:44.720456    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:01:52.825609 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:01:52.825566    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:02:03.620317 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:02:03.620278    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:02:04.413492 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:02:04.413458    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:02:15.332388 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:02:15.332349    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:02:23.929039 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:02:23.929000    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:02:34.531139 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:02:34.531057    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:02:55.923069 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:02:55.923024    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:03:05.926866 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:05.926825    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:03:09.761208 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.761176    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"]
Jul 24 19:03:09.769076 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.769047    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.771693 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.771671    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-670f312d-kserve-self-signed-certs\""
Jul 24 19:03:09.782752 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.782727    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"]
Jul 24 19:03:09.809421 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.809366    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:03:09.860426 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.860366    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-dshm\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.860584 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.860470    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-tmp-dir\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.860584 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.860518    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k2dq\" (UniqueName: \"kubernetes.io/projected/9952f3aa-d1f8-4894-b891-900c06efbebd-kube-api-access-9k2dq\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.860584 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.860544    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-home\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.860584 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.860575    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-model-cache\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.860782 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.860685    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9952f3aa-d1f8-4894-b891-900c06efbebd-tls-certs\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.961172 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.961140    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-model-cache\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.961333 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.961192    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9952f3aa-d1f8-4894-b891-900c06efbebd-tls-certs\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.961333 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.961223    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-dshm\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.961333 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.961251    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-tmp-dir\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.961333 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.961283    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k2dq\" (UniqueName: \"kubernetes.io/projected/9952f3aa-d1f8-4894-b891-900c06efbebd-kube-api-access-9k2dq\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.961333 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.961317    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-home\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.961628 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.961597    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-model-cache\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.961916 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.961674    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-home\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.961916 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.961707    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-tmp-dir\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.963411 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.963388    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-dshm\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.963811 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.963790    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9952f3aa-d1f8-4894-b891-900c06efbebd-tls-certs\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:09.969351 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:09.969324    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k2dq\" (UniqueName: \"kubernetes.io/projected/9952f3aa-d1f8-4894-b891-900c06efbebd-kube-api-access-9k2dq\") pod \"e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") " pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:10.078491 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:10.078371    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:10.211348 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:10.211322    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"]
Jul 24 19:03:10.213158 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:03:10.213133    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9952f3aa_d1f8_4894_b891_900c06efbebd.slice/crio-063a6184a306f960869db58bba8c2c2c143683653f6067564cda44760b234b21 WatchSource:0}: Error finding container 063a6184a306f960869db58bba8c2c2c143683653f6067564cda44760b234b21: Status 404 returned error can't find the container with id 063a6184a306f960869db58bba8c2c2c143683653f6067564cda44760b234b21
Jul 24 19:03:11.165653 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:11.165614    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq" event={"ID":"9952f3aa-d1f8-4894-b891-900c06efbebd","Type":"ContainerStarted","Data":"5cce5332b308bdce905520679b4947b4777d0d4820481ac9e121b867cf63f79e"}
Jul 24 19:03:11.166054 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:11.165666    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq" event={"ID":"9952f3aa-d1f8-4894-b891-900c06efbebd","Type":"ContainerStarted","Data":"063a6184a306f960869db58bba8c2c2c143683653f6067564cda44760b234b21"}
Jul 24 19:03:11.184905 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:11.184856    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq" podStartSLOduration=2.184840173 podStartE2EDuration="2.184840173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:03:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:03:11.183834484 +0000 UTC m=+1379.108787082" watchObservedRunningTime="2026-07-24 19:03:11.184840173 +0000 UTC m=+1379.109792767"
Jul 24 19:03:20.078585 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:20.078548    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:20.079137 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:20.078606    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:20.090990 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:20.090961    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:20.221764 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:20.221737    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:03:20.928895 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:20.928857    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:03:21.996355 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:21.996316    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:03:27.789735 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:27.789698    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:03:31.829866 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:03:31.829824    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:04:14.323092 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:14.323053    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"]
Jul 24 19:04:14.342959 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:14.342925    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:04:15.409847 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:15.409812    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:04:18.323814 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:18.323780    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:04:29.342836 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.342768    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq" podUID="9952f3aa-d1f8-4894-b891-900c06efbebd" containerName="main" containerID="cri-o://5cce5332b308bdce905520679b4947b4777d0d4820481ac9e121b867cf63f79e" gracePeriod=45
Jul 24 19:04:29.541151 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.541119    2557 generic.go:356] "Generic (PLEG): container finished" podID="9952f3aa-d1f8-4894-b891-900c06efbebd" containerID="5cce5332b308bdce905520679b4947b4777d0d4820481ac9e121b867cf63f79e" exitCode=0
Jul 24 19:04:29.541330 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.541172    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq" event={"ID":"9952f3aa-d1f8-4894-b891-900c06efbebd","Type":"ContainerDied","Data":"5cce5332b308bdce905520679b4947b4777d0d4820481ac9e121b867cf63f79e"}
Jul 24 19:04:29.594865 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.594797    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:04:29.672596 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.672553    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9952f3aa-d1f8-4894-b891-900c06efbebd-tls-certs\") pod \"9952f3aa-d1f8-4894-b891-900c06efbebd\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") "
Jul 24 19:04:29.672596 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.672604    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-tmp-dir\") pod \"9952f3aa-d1f8-4894-b891-900c06efbebd\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") "
Jul 24 19:04:29.672857 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.672676    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k2dq\" (UniqueName: \"kubernetes.io/projected/9952f3aa-d1f8-4894-b891-900c06efbebd-kube-api-access-9k2dq\") pod \"9952f3aa-d1f8-4894-b891-900c06efbebd\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") "
Jul 24 19:04:29.672857 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.672720    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-model-cache\") pod \"9952f3aa-d1f8-4894-b891-900c06efbebd\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") "
Jul 24 19:04:29.672857 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.672745    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-dshm\") pod \"9952f3aa-d1f8-4894-b891-900c06efbebd\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") "
Jul 24 19:04:29.672857 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.672785    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-home\") pod \"9952f3aa-d1f8-4894-b891-900c06efbebd\" (UID: \"9952f3aa-d1f8-4894-b891-900c06efbebd\") "
Jul 24 19:04:29.673066 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.672926    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9952f3aa-d1f8-4894-b891-900c06efbebd" (UID: "9952f3aa-d1f8-4894-b891-900c06efbebd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:04:29.673066 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.673006    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-model-cache" (OuterVolumeSpecName: "model-cache") pod "9952f3aa-d1f8-4894-b891-900c06efbebd" (UID: "9952f3aa-d1f8-4894-b891-900c06efbebd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:04:29.673169 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.673075    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-home" (OuterVolumeSpecName: "home") pod "9952f3aa-d1f8-4894-b891-900c06efbebd" (UID: "9952f3aa-d1f8-4894-b891-900c06efbebd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:04:29.673221 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.673199    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-model-cache\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:04:29.673221 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.673215    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-home\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:04:29.673301 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.673228    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-tmp-dir\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:04:29.674984 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.674949    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9952f3aa-d1f8-4894-b891-900c06efbebd-kube-api-access-9k2dq" (OuterVolumeSpecName: "kube-api-access-9k2dq") pod "9952f3aa-d1f8-4894-b891-900c06efbebd" (UID: "9952f3aa-d1f8-4894-b891-900c06efbebd"). InnerVolumeSpecName "kube-api-access-9k2dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:04:29.674984 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.674956    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-dshm" (OuterVolumeSpecName: "dshm") pod "9952f3aa-d1f8-4894-b891-900c06efbebd" (UID: "9952f3aa-d1f8-4894-b891-900c06efbebd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:04:29.675139 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.674989    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9952f3aa-d1f8-4894-b891-900c06efbebd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9952f3aa-d1f8-4894-b891-900c06efbebd" (UID: "9952f3aa-d1f8-4894-b891-900c06efbebd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:04:29.773981 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.773942    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k2dq\" (UniqueName: \"kubernetes.io/projected/9952f3aa-d1f8-4894-b891-900c06efbebd-kube-api-access-9k2dq\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:04:29.773981 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.773978    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9952f3aa-d1f8-4894-b891-900c06efbebd-dshm\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:04:29.774196 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:29.774002    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9952f3aa-d1f8-4894-b891-900c06efbebd-tls-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:04:30.547332 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:30.547296    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq" event={"ID":"9952f3aa-d1f8-4894-b891-900c06efbebd","Type":"ContainerDied","Data":"063a6184a306f960869db58bba8c2c2c143683653f6067564cda44760b234b21"}
Jul 24 19:04:30.547332 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:30.547319    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"
Jul 24 19:04:30.547862 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:30.547343    2557 scope.go:117] "RemoveContainer" containerID="5cce5332b308bdce905520679b4947b4777d0d4820481ac9e121b867cf63f79e"
Jul 24 19:04:30.568614 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:30.568587    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"]
Jul 24 19:04:30.572302 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:30.572278    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-670f312d-kserve-f58f876ff-zgrnq"]
Jul 24 19:04:30.622144 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:30.622108    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9952f3aa-d1f8-4894-b891-900c06efbebd" path="/var/lib/kubelet/pods/9952f3aa-d1f8-4894-b891-900c06efbebd/volumes"
Jul 24 19:04:32.524279 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:32.524238    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:04:39.027497 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:39.027451    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:04:55.129857 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:04:55.129813    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:05:04.825003 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:05:04.824959    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:05:13.823354 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:05:13.823316    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:05:21.530294 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:05:21.530259    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:05:21.817616 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:05:21.817533    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:05:32.126961 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:05:32.126926    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:05:37.115195 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:05:37.115112    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:05:41.325130 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:05:41.325094    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:05:54.726814 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:05:54.726777    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:06:03.932198 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:06:03.932158    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:06:13.724198 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:06:13.724164    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:06:25.832667 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:06:25.832632    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:06:34.827160 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:06:34.827117    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:06:41.623447 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:06:41.623409    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:06:57.421278 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:06:57.421242    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:07:09.723280 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:09.723195    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:07:20.420105 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:20.420069    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:07:22.016586 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:22.016551    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:33.531249 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:33.531205    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:07:43.271175 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:43.271136    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:43.721321 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:43.721281    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:07:46.224799 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:46.224769    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:46.324967 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:46.324934    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:46.650242 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:46.650149    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:52.261283 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:52.261241    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:52.362011 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:52.361979    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:52.487787 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:52.487746    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:53.432675 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:53.432636    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:07:54.007757 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:54.007723    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:54.067258 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:54.067222    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:54.958930 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:54.958887    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:55.055969 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:55.055933    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:55.133529 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:55.133495    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:55.287114 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:55.287024    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:55.627425 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:55.627327    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:55.728521 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:07:55.728486    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:05.831448 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:05.831411    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:08:20.453231 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:20.453197    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f"]
Jul 24 19:08:20.453647 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:20.453548    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9952f3aa-d1f8-4894-b891-900c06efbebd" containerName="main"
Jul 24 19:08:20.453647 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:20.453560    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9952f3aa-d1f8-4894-b891-900c06efbebd" containerName="main"
Jul 24 19:08:20.453647 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:20.453625    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9952f3aa-d1f8-4894-b891-900c06efbebd" containerName="main"
Jul 24 19:08:20.456503 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:20.456487    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f"
Jul 24 19:08:20.459181 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:20.459157    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:08:20.459181 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:20.459168    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:08:20.464596 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:20.464568    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f"]
Jul 24 19:08:20.503610 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:20.503577    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e021db5f-6bbe-41de-8a66-fccd8a265c95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f\" (UID: \"e021db5f-6bbe-41de-8a66-fccd8a265c95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f"
Jul 24 19:08:20.604589 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:20.604548    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e021db5f-6bbe-41de-8a66-fccd8a265c95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f\" (UID: \"e021db5f-6bbe-41de-8a66-fccd8a265c95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f"
Jul 24 19:08:20.605141 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:20.605121    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e021db5f-6bbe-41de-8a66-fccd8a265c95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f\" (UID: \"e021db5f-6bbe-41de-8a66-fccd8a265c95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f"
Jul 24 19:08:20.768309 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:20.768271    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f"
Jul 24 19:08:21.106554 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:21.106521    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f"]
Jul 24 19:08:21.108885 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:08:21.108861    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode021db5f_6bbe_41de_8a66_fccd8a265c95.slice/crio-724f94adfeb606873915f4fecbd75be8a525daafb2b2c4be4b3827879d74cc54 WatchSource:0}: Error finding container 724f94adfeb606873915f4fecbd75be8a525daafb2b2c4be4b3827879d74cc54: Status 404 returned error can't find the container with id 724f94adfeb606873915f4fecbd75be8a525daafb2b2c4be4b3827879d74cc54
Jul 24 19:08:21.111136 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:21.111115    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:08:21.627212 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:21.627181    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f" event={"ID":"e021db5f-6bbe-41de-8a66-fccd8a265c95","Type":"ContainerStarted","Data":"724f94adfeb606873915f4fecbd75be8a525daafb2b2c4be4b3827879d74cc54"}
Jul 24 19:08:24.643026 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:24.642928    2557 generic.go:356] "Generic (PLEG): container finished" podID="e021db5f-6bbe-41de-8a66-fccd8a265c95" containerID="577ee69a7e8f6892ceaef910c4a39b1f48abcb5108c9ad86ac49420145b407a6" exitCode=0
Jul 24 19:08:24.643026 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:24.642971    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f" event={"ID":"e021db5f-6bbe-41de-8a66-fccd8a265c95","Type":"ContainerDied","Data":"577ee69a7e8f6892ceaef910c4a39b1f48abcb5108c9ad86ac49420145b407a6"}
Jul 24 19:08:25.778244 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:25.778219    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f"
Jul 24 19:08:25.850874 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:25.850842    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e021db5f-6bbe-41de-8a66-fccd8a265c95-maas-api-service-ca\") pod \"e021db5f-6bbe-41de-8a66-fccd8a265c95\" (UID: \"e021db5f-6bbe-41de-8a66-fccd8a265c95\") "
Jul 24 19:08:25.851201 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:25.851176    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e021db5f-6bbe-41de-8a66-fccd8a265c95-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e021db5f-6bbe-41de-8a66-fccd8a265c95" (UID: "e021db5f-6bbe-41de-8a66-fccd8a265c95"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:08:25.951863 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:25.951764    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e021db5f-6bbe-41de-8a66-fccd8a265c95-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:08:26.653919 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:26.653891    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f"
Jul 24 19:08:26.653919 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:26.653904    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f" event={"ID":"e021db5f-6bbe-41de-8a66-fccd8a265c95","Type":"ContainerDied","Data":"724f94adfeb606873915f4fecbd75be8a525daafb2b2c4be4b3827879d74cc54"}
Jul 24 19:08:26.654126 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:26.653950    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="724f94adfeb606873915f4fecbd75be8a525daafb2b2c4be4b3827879d74cc54"
Jul 24 19:08:30.903938 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:30.903908    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:31.005170 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:31.005140    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:31.106223 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:31.106192    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:34.022843 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:34.022809    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:08:35.528113 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:35.528074    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:35.534125 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:35.534097    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f"]
Jul 24 19:08:35.537606 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:35.537576    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed084fc-lq66f"]
Jul 24 19:08:35.688820 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:35.688788    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:35.940651 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:35.940557    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:36.173987 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.173953    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:36.281537 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.281500    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:36.374871 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.374837    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:36.623050 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.622970    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e021db5f-6bbe-41de-8a66-fccd8a265c95" path="/var/lib/kubelet/pods/e021db5f-6bbe-41de-8a66-fccd8a265c95/volumes"
Jul 24 19:08:36.681864 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.681833    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"]
Jul 24 19:08:36.682210 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.682194    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e021db5f-6bbe-41de-8a66-fccd8a265c95" containerName="revoke-keys"
Jul 24 19:08:36.682210 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.682208    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e021db5f-6bbe-41de-8a66-fccd8a265c95" containerName="revoke-keys"
Jul 24 19:08:36.682285 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.682281    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e021db5f-6bbe-41de-8a66-fccd8a265c95" containerName="revoke-keys"
Jul 24 19:08:36.688318 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.688294    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.690924 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.690903    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-889a9e38-gw-openshift-default-dockercfg-fdt96\""
Jul 24 19:08:36.700911 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.700884    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"]
Jul 24 19:08:36.702894 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.702860    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:36.853027 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.852986    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-workload-certs\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.853243 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.853036    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-istio-data\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.853243 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.853064    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aadee062-58f0-49ff-8acd-5182be100ddd-istio-podinfo\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.853243 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.853137    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-workload-socket\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.853243 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.853176    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aadee062-58f0-49ff-8acd-5182be100ddd-istiod-ca-cert\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.853243 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.853198    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-credential-socket\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.853243 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.853218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aadee062-58f0-49ff-8acd-5182be100ddd-istio-token\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.853588 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.853268    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh27p\" (UniqueName: \"kubernetes.io/projected/aadee062-58f0-49ff-8acd-5182be100ddd-kube-api-access-jh27p\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.853588 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.853308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-istio-envoy\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.954685 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.954569    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-workload-certs\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.954685 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.954632    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-istio-data\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.954685 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.954655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aadee062-58f0-49ff-8acd-5182be100ddd-istio-podinfo\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.954685 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.954682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-workload-socket\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.955020 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.954712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aadee062-58f0-49ff-8acd-5182be100ddd-istiod-ca-cert\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.955020 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.954734    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-credential-socket\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.955020 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.954749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aadee062-58f0-49ff-8acd-5182be100ddd-istio-token\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.955020 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.954772    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh27p\" (UniqueName: \"kubernetes.io/projected/aadee062-58f0-49ff-8acd-5182be100ddd-kube-api-access-jh27p\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.955020 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.954807    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-istio-envoy\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.955276 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.955192    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-credential-socket\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.955276 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.955202    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-workload-certs\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.955544 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.955521    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-workload-socket\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.955635 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.955525    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-istio-data\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.955690 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.955642    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aadee062-58f0-49ff-8acd-5182be100ddd-istiod-ca-cert\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.957433 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.957352    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-istio-envoy\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.957555 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.957484    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aadee062-58f0-49ff-8acd-5182be100ddd-istio-podinfo\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.963522 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.963492    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh27p\" (UniqueName: \"kubernetes.io/projected/aadee062-58f0-49ff-8acd-5182be100ddd-kube-api-access-jh27p\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:36.963706 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:36.963682    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aadee062-58f0-49ff-8acd-5182be100ddd-istio-token\") pod \"e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") " pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:37.001065 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:37.001009    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:37.020334 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:37.020308    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:37.150270 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:37.150245    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"]
Jul 24 19:08:37.152453 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:08:37.152424    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaadee062_58f0_49ff_8acd_5182be100ddd.slice/crio-ff0b596eedf2e964626772c7ca3789e2953ca09d8a995fad86f1272ae7bb4720 WatchSource:0}: Error finding container ff0b596eedf2e964626772c7ca3789e2953ca09d8a995fad86f1272ae7bb4720: Status 404 returned error can't find the container with id ff0b596eedf2e964626772c7ca3789e2953ca09d8a995fad86f1272ae7bb4720
Jul 24 19:08:37.711127 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:37.711087    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl" event={"ID":"aadee062-58f0-49ff-8acd-5182be100ddd","Type":"ContainerStarted","Data":"ff0b596eedf2e964626772c7ca3789e2953ca09d8a995fad86f1272ae7bb4720"}
Jul 24 19:08:39.780284 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:39.780249    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:08:39.780573 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:39.780322    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:08:39.780573 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:39.780354    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:08:40.728057 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:40.728016    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl" event={"ID":"aadee062-58f0-49ff-8acd-5182be100ddd","Type":"ContainerStarted","Data":"99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba"}
Jul 24 19:08:40.748169 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:40.748113    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl" podStartSLOduration=2.122958618 podStartE2EDuration="4.748095309s" totalImagesPullingTime="2.625136691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:08:40.74625701 +0000 UTC m=+1708.671209605" watchObservedRunningTime="2026-07-24 19:08:40.748095309 +0000 UTC m=+1708.673047903"
Jul 24 19:08:41.001990 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:41.001907    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:41.006724 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:41.006695    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:41.733418 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:41.733369    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:41.734444 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:41.734422    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:42.228151 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:42.228123    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:42.340019 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:42.339987    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:42.817963 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:42.817932    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:42.918960 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:42.918924    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:43.038629 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:43.038589    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:45.428481 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:45.428436    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:08:53.791878 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:53.791845    2557 generic.go:356] "Generic (PLEG): container finished" podID="aadee062-58f0-49ff-8acd-5182be100ddd" containerID="99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba" exitCode=0
Jul 24 19:08:53.792315 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:53.791921    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl" event={"ID":"aadee062-58f0-49ff-8acd-5182be100ddd","Type":"ContainerDied","Data":"99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba"}
Jul 24 19:08:53.792315 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:53.792297    2557 scope.go:117] "RemoveContainer" containerID="99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba"
Jul 24 19:08:53.793411 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:53.793361    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:08:53.793478 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:53.793453    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:08:53.793515 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:53.793484    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:08:54.802436 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:54.802368    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl" event={"ID":"aadee062-58f0-49ff-8acd-5182be100ddd","Type":"ContainerStarted","Data":"04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a"}
Jul 24 19:08:55.003446 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:55.002963    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:55.003446 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:55.003101    2557 patch_prober.go:28] interesting pod/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 24 19:08:55.003446 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:55.003146    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl" podUID="aadee062-58f0-49ff-8acd-5182be100ddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 24 19:08:56.001754 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:56.001709    2557 patch_prober.go:28] interesting pod/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 24 19:08:56.002258 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:56.001774    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl" podUID="aadee062-58f0-49ff-8acd-5182be100ddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 24 19:08:56.733743 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:56.733700    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:57.002313 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:57.002203    2557 patch_prober.go:28] interesting pod/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 24 19:08:57.002313 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:57.002276    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl" podUID="aadee062-58f0-49ff-8acd-5182be100ddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 24 19:08:58.001795 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:58.001751    2557 patch_prober.go:28] interesting pod/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 24 19:08:58.002016 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:58.001827    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl" podUID="aadee062-58f0-49ff-8acd-5182be100ddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 24 19:08:59.006273 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:59.006243    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:08:59.007362 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:08:59.007343    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:09:07.189850 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.189802    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv"]
Jul 24 19:09:07.192257 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.192239    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv"
Jul 24 19:09:07.194589 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.194559    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:09:07.194734 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.194594    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:09:07.200838 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.200814    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv"]
Jul 24 19:09:07.340629 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.340594    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d9a7c3-3f13-419f-bcbb-a75e604063dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv\" (UID: \"27d9a7c3-3f13-419f-bcbb-a75e604063dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv"
Jul 24 19:09:07.442149 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.442053    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d9a7c3-3f13-419f-bcbb-a75e604063dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv\" (UID: \"27d9a7c3-3f13-419f-bcbb-a75e604063dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv"
Jul 24 19:09:07.442703 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.442684    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d9a7c3-3f13-419f-bcbb-a75e604063dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv\" (UID: \"27d9a7c3-3f13-419f-bcbb-a75e604063dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv"
Jul 24 19:09:07.504268 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.504218    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv"
Jul 24 19:09:07.642490 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.642462    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv"]
Jul 24 19:09:07.645368 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:09:07.645336    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d9a7c3_3f13_419f_bcbb_a75e604063dd.slice/crio-689c18fb692240686601da27892ac546de81aa3ce4d1aaf1cc16b42254d08559 WatchSource:0}: Error finding container 689c18fb692240686601da27892ac546de81aa3ce4d1aaf1cc16b42254d08559: Status 404 returned error can't find the container with id 689c18fb692240686601da27892ac546de81aa3ce4d1aaf1cc16b42254d08559
Jul 24 19:09:07.870086 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.870051    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv" event={"ID":"27d9a7c3-3f13-419f-bcbb-a75e604063dd","Type":"ContainerStarted","Data":"cecbd37bdbb959ea1dd10eb25b11f8d635b3fd4cbeb8132ae646dd6f662df190"}
Jul 24 19:09:07.870295 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.870102    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv" event={"ID":"27d9a7c3-3f13-419f-bcbb-a75e604063dd","Type":"ContainerStarted","Data":"689c18fb692240686601da27892ac546de81aa3ce4d1aaf1cc16b42254d08559"}
Jul 24 19:09:07.886497 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:07.886413    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv" podStartSLOduration=0.88639677 podStartE2EDuration="886.39677ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:09:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:09:07.885557873 +0000 UTC m=+1735.810510477" watchObservedRunningTime="2026-07-24 19:09:07.88639677 +0000 UTC m=+1735.811349355"
Jul 24 19:09:08.876113 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:08.876077    2557 generic.go:356] "Generic (PLEG): container finished" podID="27d9a7c3-3f13-419f-bcbb-a75e604063dd" containerID="cecbd37bdbb959ea1dd10eb25b11f8d635b3fd4cbeb8132ae646dd6f662df190" exitCode=0
Jul 24 19:09:08.876691 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:08.876155    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv" event={"ID":"27d9a7c3-3f13-419f-bcbb-a75e604063dd","Type":"ContainerDied","Data":"cecbd37bdbb959ea1dd10eb25b11f8d635b3fd4cbeb8132ae646dd6f662df190"}
Jul 24 19:09:10.011594 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:10.011571    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv"
Jul 24 19:09:10.170525 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:10.170412    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d9a7c3-3f13-419f-bcbb-a75e604063dd-maas-api-service-ca\") pod \"27d9a7c3-3f13-419f-bcbb-a75e604063dd\" (UID: \"27d9a7c3-3f13-419f-bcbb-a75e604063dd\") "
Jul 24 19:09:10.170783 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:10.170760    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d9a7c3-3f13-419f-bcbb-a75e604063dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "27d9a7c3-3f13-419f-bcbb-a75e604063dd" (UID: "27d9a7c3-3f13-419f-bcbb-a75e604063dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:09:10.271122 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:10.271081    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d9a7c3-3f13-419f-bcbb-a75e604063dd-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:09:10.886348 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:10.886264    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv"
Jul 24 19:09:10.886348 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:10.886305    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv" event={"ID":"27d9a7c3-3f13-419f-bcbb-a75e604063dd","Type":"ContainerDied","Data":"689c18fb692240686601da27892ac546de81aa3ce4d1aaf1cc16b42254d08559"}
Jul 24 19:09:10.886555 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:10.886352    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="689c18fb692240686601da27892ac546de81aa3ce4d1aaf1cc16b42254d08559"
Jul 24 19:09:17.642882 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:17.642844    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:17.743551 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:17.743515    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:17.843911 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:17.843870    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:20.426624 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:20.426587    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:09:22.269190 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:22.269155    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:22.351819 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:22.351776    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv"]
Jul 24 19:09:22.353471 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:22.353450    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-889a9e38-7cqlv"]
Jul 24 19:09:22.483634 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:22.483595    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"]
Jul 24 19:09:22.483859 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:22.483806    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl" podUID="aadee062-58f0-49ff-8acd-5182be100ddd" containerName="istio-proxy" containerID="cri-o://04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a" gracePeriod=30
Jul 24 19:09:22.508910 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:22.508879    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:22.621990 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:22.621893    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27d9a7c3-3f13-419f-bcbb-a75e604063dd" path="/var/lib/kubelet/pods/27d9a7c3-3f13-419f-bcbb-a75e604063dd/volumes"
Jul 24 19:09:22.757018 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:22.756980    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:22.960753 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:22.960723    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:23.237293 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.237195    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"]
Jul 24 19:09:23.237882 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.237710    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d9a7c3-3f13-419f-bcbb-a75e604063dd" containerName="revoke-keys"
Jul 24 19:09:23.237882 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.237734    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d9a7c3-3f13-419f-bcbb-a75e604063dd" containerName="revoke-keys"
Jul 24 19:09:23.237882 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.237859    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="27d9a7c3-3f13-419f-bcbb-a75e604063dd" containerName="revoke-keys"
Jul 24 19:09:23.240911 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.240889    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.243396 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.243352    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ff1b2177-openshift-default-dockercfg-8wdj4\""
Jul 24 19:09:23.251725 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.251701    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"]
Jul 24 19:09:23.270305 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.270272    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:23.388613 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.388572    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-workload-socket\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.388761 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.388620    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4887236-dd90-44f9-af46-b9c842072898-istio-token\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.388761 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.388709    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-workload-certs\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.388858 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.388781    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4887236-dd90-44f9-af46-b9c842072898-istiod-ca-cert\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.388858 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.388815    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-credential-socket\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.388858 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.388832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-istio-data\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.388958 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.388891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87n82\" (UniqueName: \"kubernetes.io/projected/d4887236-dd90-44f9-af46-b9c842072898-kube-api-access-87n82\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.388958 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.388917    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4887236-dd90-44f9-af46-b9c842072898-istio-podinfo\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.388958 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.388941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-istio-envoy\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490198 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490105    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-credential-socket\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490198 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490156    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-istio-data\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490452 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490195    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87n82\" (UniqueName: \"kubernetes.io/projected/d4887236-dd90-44f9-af46-b9c842072898-kube-api-access-87n82\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490452 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490228    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4887236-dd90-44f9-af46-b9c842072898-istio-podinfo\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490452 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490262    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-istio-envoy\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490452 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490296    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-workload-socket\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490452 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4887236-dd90-44f9-af46-b9c842072898-istio-token\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490452 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490391    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-workload-certs\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490784 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490461    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4887236-dd90-44f9-af46-b9c842072898-istiod-ca-cert\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490784 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490571    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-istio-data\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490784 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490624    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-credential-socket\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490934 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490841    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-workload-socket\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.490934 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.490907    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-workload-certs\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.491169 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.491146    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4887236-dd90-44f9-af46-b9c842072898-istiod-ca-cert\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.492709 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.492680    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-istio-envoy\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.492906 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.492887    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4887236-dd90-44f9-af46-b9c842072898-istio-podinfo\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.498476 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.498447    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87n82\" (UniqueName: \"kubernetes.io/projected/d4887236-dd90-44f9-af46-b9c842072898-kube-api-access-87n82\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.498616 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.498589    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4887236-dd90-44f9-af46-b9c842072898-istio-token\") pod \"e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") " pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.553270 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.553225    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:23.674846 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.674795    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:23.715484 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.715456    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"]
Jul 24 19:09:23.717505 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:09:23.717475    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4887236_dd90_44f9_af46_b9c842072898.slice/crio-1519951d66cd6d56628793590ac0f34a2c426cda8d06ed57ecd09e5d751b7823 WatchSource:0}: Error finding container 1519951d66cd6d56628793590ac0f34a2c426cda8d06ed57ecd09e5d751b7823: Status 404 returned error can't find the container with id 1519951d66cd6d56628793590ac0f34a2c426cda8d06ed57ecd09e5d751b7823
Jul 24 19:09:23.719740 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.719709    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:09:23.719849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.719776    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:09:23.719849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.719804    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:09:23.954437 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.954400    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" event={"ID":"d4887236-dd90-44f9-af46-b9c842072898","Type":"ContainerStarted","Data":"274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5"}
Jul 24 19:09:23.954605 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.954462    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" event={"ID":"d4887236-dd90-44f9-af46-b9c842072898","Type":"ContainerStarted","Data":"1519951d66cd6d56628793590ac0f34a2c426cda8d06ed57ecd09e5d751b7823"}
Jul 24 19:09:23.973933 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:23.973881    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" podStartSLOduration=0.973863967 podStartE2EDuration="973.863967ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:09:23.972083008 +0000 UTC m=+1751.897035624" watchObservedRunningTime="2026-07-24 19:09:23.973863967 +0000 UTC m=+1751.898816777"
Jul 24 19:09:24.553917 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:24.553881    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:24.555560 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:24.555533    2557 patch_prober.go:28] interesting pod/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 24 19:09:24.555643 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:24.555593    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" podUID="d4887236-dd90-44f9-af46-b9c842072898" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 24 19:09:25.301069 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:25.301026    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:25.395232 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:25.395199    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:25.467080 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:25.467044    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:25.558355 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:25.558266    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:25.784502 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:25.784462    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:25.965316 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:25.965291    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:25.966188 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:25.966164    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:26.113865 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:26.113831    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:26.212753 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:26.212719    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:27.745595 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.745566    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:09:27.932013 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.931899    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aadee062-58f0-49ff-8acd-5182be100ddd-istio-podinfo\") pod \"aadee062-58f0-49ff-8acd-5182be100ddd\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") "
Jul 24 19:09:27.932013 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.931994    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-workload-certs\") pod \"aadee062-58f0-49ff-8acd-5182be100ddd\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") "
Jul 24 19:09:27.932296 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932035    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-istio-data\") pod \"aadee062-58f0-49ff-8acd-5182be100ddd\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") "
Jul 24 19:09:27.932296 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932069    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aadee062-58f0-49ff-8acd-5182be100ddd-istiod-ca-cert\") pod \"aadee062-58f0-49ff-8acd-5182be100ddd\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") "
Jul 24 19:09:27.932296 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932106    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-credential-socket\") pod \"aadee062-58f0-49ff-8acd-5182be100ddd\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") "
Jul 24 19:09:27.932296 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932134    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-istio-envoy\") pod \"aadee062-58f0-49ff-8acd-5182be100ddd\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") "
Jul 24 19:09:27.932296 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932185    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aadee062-58f0-49ff-8acd-5182be100ddd-istio-token\") pod \"aadee062-58f0-49ff-8acd-5182be100ddd\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") "
Jul 24 19:09:27.932296 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932209    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh27p\" (UniqueName: \"kubernetes.io/projected/aadee062-58f0-49ff-8acd-5182be100ddd-kube-api-access-jh27p\") pod \"aadee062-58f0-49ff-8acd-5182be100ddd\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") "
Jul 24 19:09:27.932296 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932261    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-workload-socket\") pod \"aadee062-58f0-49ff-8acd-5182be100ddd\" (UID: \"aadee062-58f0-49ff-8acd-5182be100ddd\") "
Jul 24 19:09:27.932688 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932357    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aadee062-58f0-49ff-8acd-5182be100ddd" (UID: "aadee062-58f0-49ff-8acd-5182be100ddd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:09:27.932688 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932538    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aadee062-58f0-49ff-8acd-5182be100ddd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aadee062-58f0-49ff-8acd-5182be100ddd" (UID: "aadee062-58f0-49ff-8acd-5182be100ddd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:09:27.932688 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932428    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aadee062-58f0-49ff-8acd-5182be100ddd" (UID: "aadee062-58f0-49ff-8acd-5182be100ddd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:09:27.932688 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932629    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aadee062-58f0-49ff-8acd-5182be100ddd" (UID: "aadee062-58f0-49ff-8acd-5182be100ddd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:09:27.932908 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932766    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aadee062-58f0-49ff-8acd-5182be100ddd-istiod-ca-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:09:27.932908 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932787    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-credential-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:09:27.932908 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932801    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-workload-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:09:27.932908 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932814    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-workload-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:09:27.933114 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.932938    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-istio-data" (OuterVolumeSpecName: "istio-data") pod "aadee062-58f0-49ff-8acd-5182be100ddd" (UID: "aadee062-58f0-49ff-8acd-5182be100ddd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:09:27.934482 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.934452    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aadee062-58f0-49ff-8acd-5182be100ddd" (UID: "aadee062-58f0-49ff-8acd-5182be100ddd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:09:27.934621 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.934501    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aadee062-58f0-49ff-8acd-5182be100ddd-kube-api-access-jh27p" (OuterVolumeSpecName: "kube-api-access-jh27p") pod "aadee062-58f0-49ff-8acd-5182be100ddd" (UID: "aadee062-58f0-49ff-8acd-5182be100ddd"). InnerVolumeSpecName "kube-api-access-jh27p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:09:27.934621 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.934598    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aadee062-58f0-49ff-8acd-5182be100ddd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aadee062-58f0-49ff-8acd-5182be100ddd" (UID: "aadee062-58f0-49ff-8acd-5182be100ddd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:09:27.934725 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.934599    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aadee062-58f0-49ff-8acd-5182be100ddd-istio-token" (OuterVolumeSpecName: "istio-token") pod "aadee062-58f0-49ff-8acd-5182be100ddd" (UID: "aadee062-58f0-49ff-8acd-5182be100ddd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:09:27.976506 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.976468    2557 generic.go:356] "Generic (PLEG): container finished" podID="aadee062-58f0-49ff-8acd-5182be100ddd" containerID="04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a" exitCode=0
Jul 24 19:09:27.976664 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.976543    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"
Jul 24 19:09:27.976664 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.976563    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl" event={"ID":"aadee062-58f0-49ff-8acd-5182be100ddd","Type":"ContainerDied","Data":"04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a"}
Jul 24 19:09:27.976664 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.976618    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl" event={"ID":"aadee062-58f0-49ff-8acd-5182be100ddd","Type":"ContainerDied","Data":"ff0b596eedf2e964626772c7ca3789e2953ca09d8a995fad86f1272ae7bb4720"}
Jul 24 19:09:27.976664 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.976642    2557 scope.go:117] "RemoveContainer" containerID="04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a"
Jul 24 19:09:27.986472 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.986449    2557 scope.go:117] "RemoveContainer" containerID="99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba"
Jul 24 19:09:27.995517 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.995413    2557 scope.go:117] "RemoveContainer" containerID="04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a"
Jul 24 19:09:27.996058 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:09:27.995917    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a\": container with ID starting with 04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a not found: ID does not exist" containerID="04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a"
Jul 24 19:09:27.996058 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.995949    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a"} err="failed to get container status \"04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a\": rpc error: code = NotFound desc = could not find container \"04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a\": container with ID starting with 04a3534bc15c8508d5d855906ab79fdc7259bf295886645e6f7ee15fccb9e39a not found: ID does not exist"
Jul 24 19:09:27.996058 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.995968    2557 scope.go:117] "RemoveContainer" containerID="99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba"
Jul 24 19:09:27.996288 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:09:27.996260    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba\": container with ID starting with 99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba not found: ID does not exist" containerID="99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba"
Jul 24 19:09:27.996329 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.996297    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba"} err="failed to get container status \"99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba\": rpc error: code = NotFound desc = could not find container \"99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba\": container with ID starting with 99a3bbf68a873e50c704eb54c67994b7df76faa48be582c03a7be99339801fba not found: ID does not exist"
Jul 24 19:09:27.997762 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:27.997740    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"]
Jul 24 19:09:28.002662 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:28.002632    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-889a9e38-gw-openshift-default-765bfb56dd-282kl"]
Jul 24 19:09:28.034075 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:28.034042    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-istio-envoy\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:09:28.034075 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:28.034068    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aadee062-58f0-49ff-8acd-5182be100ddd-istio-token\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:09:28.034075 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:28.034077    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh27p\" (UniqueName: \"kubernetes.io/projected/aadee062-58f0-49ff-8acd-5182be100ddd-kube-api-access-jh27p\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:09:28.034284 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:28.034087    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aadee062-58f0-49ff-8acd-5182be100ddd-istio-podinfo\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:09:28.034284 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:28.034097    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aadee062-58f0-49ff-8acd-5182be100ddd-istio-data\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:09:28.621788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:28.621758    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aadee062-58f0-49ff-8acd-5182be100ddd" path="/var/lib/kubelet/pods/aadee062-58f0-49ff-8acd-5182be100ddd/volumes"
Jul 24 19:09:31.326505 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:31.326463    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:09:39.044172 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:39.044134    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4887236-dd90-44f9-af46-b9c842072898" containerID="274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5" exitCode=0
Jul 24 19:09:39.044729 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:39.044212    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" event={"ID":"d4887236-dd90-44f9-af46-b9c842072898","Type":"ContainerDied","Data":"274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5"}
Jul 24 19:09:39.044804 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:39.044754    2557 scope.go:117] "RemoveContainer" containerID="274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5"
Jul 24 19:09:39.045803 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:39.045773    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:09:39.045909 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:39.045846    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:09:39.045909 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:39.045880    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:09:40.050727 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:40.050680    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" event={"ID":"d4887236-dd90-44f9-af46-b9c842072898","Type":"ContainerStarted","Data":"f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373"}
Jul 24 19:09:40.553736 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:40.553693    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:40.554944 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:40.554916    2557 patch_prober.go:28] interesting pod/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 24 19:09:40.555068 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:40.554976    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" podUID="d4887236-dd90-44f9-af46-b9c842072898" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 24 19:09:40.965350 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:40.965321    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:41.553611 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:41.553580    2557 patch_prober.go:28] interesting pod/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 24 19:09:41.554001 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:41.553640    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" podUID="d4887236-dd90-44f9-af46-b9c842072898" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 24 19:09:42.554086 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:42.554044    2557 patch_prober.go:28] interesting pod/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 24 19:09:42.554545 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:42.554116    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" podUID="d4887236-dd90-44f9-af46-b9c842072898" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 24 19:09:43.554393 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:43.554324    2557 patch_prober.go:28] interesting pod/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 24 19:09:43.554805 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:43.554409    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" podUID="d4887236-dd90-44f9-af46-b9c842072898" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 24 19:09:44.558053 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:44.558022    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:44.559115 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:44.559094    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:09:51.077591 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.077545    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr"]
Jul 24 19:09:51.077991 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.077898    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadee062-58f0-49ff-8acd-5182be100ddd" containerName="istio-proxy"
Jul 24 19:09:51.077991 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.077909    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadee062-58f0-49ff-8acd-5182be100ddd" containerName="istio-proxy"
Jul 24 19:09:51.077991 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.077923    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadee062-58f0-49ff-8acd-5182be100ddd" containerName="istio-proxy"
Jul 24 19:09:51.077991 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.077928    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadee062-58f0-49ff-8acd-5182be100ddd" containerName="istio-proxy"
Jul 24 19:09:51.078119 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.077994    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="aadee062-58f0-49ff-8acd-5182be100ddd" containerName="istio-proxy"
Jul 24 19:09:51.081039 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.081022    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr"
Jul 24 19:09:51.083714 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.083691    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:09:51.083843 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.083698    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:09:51.087960 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.087925    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr"]
Jul 24 19:09:51.139075 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.139042    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85d7c2d6-92c1-485f-ac0c-e84cbf827a81-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr\" (UID: \"85d7c2d6-92c1-485f-ac0c-e84cbf827a81\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr"
Jul 24 19:09:51.239597 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.239558    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85d7c2d6-92c1-485f-ac0c-e84cbf827a81-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr\" (UID: \"85d7c2d6-92c1-485f-ac0c-e84cbf827a81\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr"
Jul 24 19:09:51.240294 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.240273    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85d7c2d6-92c1-485f-ac0c-e84cbf827a81-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr\" (UID: \"85d7c2d6-92c1-485f-ac0c-e84cbf827a81\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr"
Jul 24 19:09:51.393807 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.393712    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr"
Jul 24 19:09:51.529088 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:51.529057    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr"]
Jul 24 19:09:51.531058 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:09:51.531032    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d7c2d6_92c1_485f_ac0c_e84cbf827a81.slice/crio-84be0fb21d4c1c8c8922426618fa0fb745dd13371d688f926c3d71187a07e1ab WatchSource:0}: Error finding container 84be0fb21d4c1c8c8922426618fa0fb745dd13371d688f926c3d71187a07e1ab: Status 404 returned error can't find the container with id 84be0fb21d4c1c8c8922426618fa0fb745dd13371d688f926c3d71187a07e1ab
Jul 24 19:09:52.113630 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:52.113544    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr" event={"ID":"85d7c2d6-92c1-485f-ac0c-e84cbf827a81","Type":"ContainerStarted","Data":"e9c3ed61b182a38857a77607989e104e4fabadceda63622c732f3ff6e7774aa0"}
Jul 24 19:09:52.113630 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:52.113600    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr" event={"ID":"85d7c2d6-92c1-485f-ac0c-e84cbf827a81","Type":"ContainerStarted","Data":"84be0fb21d4c1c8c8922426618fa0fb745dd13371d688f926c3d71187a07e1ab"}
Jul 24 19:09:52.139941 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:52.139886    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr" podStartSLOduration=1.139868594 podStartE2EDuration="1.139868594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:09:52.138435884 +0000 UTC m=+1780.063388479" watchObservedRunningTime="2026-07-24 19:09:52.139868594 +0000 UTC m=+1780.064821188"
Jul 24 19:09:53.120158 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:53.120126    2557 generic.go:356] "Generic (PLEG): container finished" podID="85d7c2d6-92c1-485f-ac0c-e84cbf827a81" containerID="e9c3ed61b182a38857a77607989e104e4fabadceda63622c732f3ff6e7774aa0" exitCode=0
Jul 24 19:09:53.120604 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:53.120170    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr" event={"ID":"85d7c2d6-92c1-485f-ac0c-e84cbf827a81","Type":"ContainerDied","Data":"e9c3ed61b182a38857a77607989e104e4fabadceda63622c732f3ff6e7774aa0"}
Jul 24 19:09:54.263102 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:54.263078    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr"
Jul 24 19:09:54.371667 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:54.371623    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85d7c2d6-92c1-485f-ac0c-e84cbf827a81-maas-api-service-ca\") pod \"85d7c2d6-92c1-485f-ac0c-e84cbf827a81\" (UID: \"85d7c2d6-92c1-485f-ac0c-e84cbf827a81\") "
Jul 24 19:09:54.372035 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:54.372011    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85d7c2d6-92c1-485f-ac0c-e84cbf827a81-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "85d7c2d6-92c1-485f-ac0c-e84cbf827a81" (UID: "85d7c2d6-92c1-485f-ac0c-e84cbf827a81"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:09:54.473218 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:54.473188    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85d7c2d6-92c1-485f-ac0c-e84cbf827a81-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:09:55.131147 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:55.131115    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr"
Jul 24 19:09:55.131323 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:55.131116    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr" event={"ID":"85d7c2d6-92c1-485f-ac0c-e84cbf827a81","Type":"ContainerDied","Data":"84be0fb21d4c1c8c8922426618fa0fb745dd13371d688f926c3d71187a07e1ab"}
Jul 24 19:09:55.131323 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:09:55.131243    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84be0fb21d4c1c8c8922426618fa0fb745dd13371d688f926c3d71187a07e1ab"
Jul 24 19:10:01.510590 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:01.510554    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:01.611154 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:01.611120    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:01.710901 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:01.710852    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:04.420007 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:04.419921    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:10:05.280297 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:05.280254    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:05.378478 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:05.378444    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:06.153998 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:06.153960    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr"]
Jul 24 19:10:06.156631 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:06.156597    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff1b2177-5k2fr"]
Jul 24 19:10:06.157509 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:06.157486    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:06.621726 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:06.621690    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85d7c2d6-92c1-485f-ac0c-e84cbf827a81" path="/var/lib/kubelet/pods/85d7c2d6-92c1-485f-ac0c-e84cbf827a81/volumes"
Jul 24 19:10:07.332257 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:07.332219    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"]
Jul 24 19:10:07.332798 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:07.332558    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" podUID="d4887236-dd90-44f9-af46-b9c842072898" containerName="istio-proxy" containerID="cri-o://f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373" gracePeriod=30
Jul 24 19:10:07.360335 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:07.360297    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:07.566926 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:07.566892    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:07.790844 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:07.790811    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:08.135218 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:08.135126    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:08.730839 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:08.730809    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:10.659427 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:10.659344    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:10.757647 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:10.757609    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:11.735016 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:11.734973    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:12.198607 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.198517    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:12.302342 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.302307    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:12.613187 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.613161    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:10:12.740239 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740209    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-istio-data\") pod \"d4887236-dd90-44f9-af46-b9c842072898\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") "
Jul 24 19:10:12.740788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740250    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-credential-socket\") pod \"d4887236-dd90-44f9-af46-b9c842072898\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") "
Jul 24 19:10:12.740788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740268    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-istio-envoy\") pod \"d4887236-dd90-44f9-af46-b9c842072898\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") "
Jul 24 19:10:12.740788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740294    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-workload-socket\") pod \"d4887236-dd90-44f9-af46-b9c842072898\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") "
Jul 24 19:10:12.740788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740350    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-workload-certs\") pod \"d4887236-dd90-44f9-af46-b9c842072898\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") "
Jul 24 19:10:12.740788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740440    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87n82\" (UniqueName: \"kubernetes.io/projected/d4887236-dd90-44f9-af46-b9c842072898-kube-api-access-87n82\") pod \"d4887236-dd90-44f9-af46-b9c842072898\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") "
Jul 24 19:10:12.740788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740463    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4887236-dd90-44f9-af46-b9c842072898-istio-podinfo\") pod \"d4887236-dd90-44f9-af46-b9c842072898\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") "
Jul 24 19:10:12.740788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740488    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4887236-dd90-44f9-af46-b9c842072898-istiod-ca-cert\") pod \"d4887236-dd90-44f9-af46-b9c842072898\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") "
Jul 24 19:10:12.740788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740565    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4887236-dd90-44f9-af46-b9c842072898-istio-token\") pod \"d4887236-dd90-44f9-af46-b9c842072898\" (UID: \"d4887236-dd90-44f9-af46-b9c842072898\") "
Jul 24 19:10:12.740788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740642    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4887236-dd90-44f9-af46-b9c842072898" (UID: "d4887236-dd90-44f9-af46-b9c842072898"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:12.741312 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740898    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4887236-dd90-44f9-af46-b9c842072898-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4887236-dd90-44f9-af46-b9c842072898" (UID: "d4887236-dd90-44f9-af46-b9c842072898"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:10:12.741312 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740867    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4887236-dd90-44f9-af46-b9c842072898" (UID: "d4887236-dd90-44f9-af46-b9c842072898"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:12.741312 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.740946    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4887236-dd90-44f9-af46-b9c842072898" (UID: "d4887236-dd90-44f9-af46-b9c842072898"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:12.741312 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.741157    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4887236-dd90-44f9-af46-b9c842072898" (UID: "d4887236-dd90-44f9-af46-b9c842072898"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:12.741312 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.741220    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-workload-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:10:12.741312 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.741236    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4887236-dd90-44f9-af46-b9c842072898-istiod-ca-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:10:12.741312 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.741250    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-istio-data\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:10:12.741312 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.741262    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-credential-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:10:12.741312 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.741277    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-workload-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:10:12.742901 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.742873    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4887236-dd90-44f9-af46-b9c842072898-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4887236-dd90-44f9-af46-b9c842072898" (UID: "d4887236-dd90-44f9-af46-b9c842072898"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:10:12.743060 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.743036    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4887236-dd90-44f9-af46-b9c842072898" (UID: "d4887236-dd90-44f9-af46-b9c842072898"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:12.743129 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.743061    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4887236-dd90-44f9-af46-b9c842072898-kube-api-access-87n82" (OuterVolumeSpecName: "kube-api-access-87n82") pod "d4887236-dd90-44f9-af46-b9c842072898" (UID: "d4887236-dd90-44f9-af46-b9c842072898"). InnerVolumeSpecName "kube-api-access-87n82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:10:12.743129 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.743097    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4887236-dd90-44f9-af46-b9c842072898-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4887236-dd90-44f9-af46-b9c842072898" (UID: "d4887236-dd90-44f9-af46-b9c842072898"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:10:12.842535 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.842500    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4887236-dd90-44f9-af46-b9c842072898-istio-envoy\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:10:12.842535 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.842528    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87n82\" (UniqueName: \"kubernetes.io/projected/d4887236-dd90-44f9-af46-b9c842072898-kube-api-access-87n82\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:10:12.842535 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.842539    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4887236-dd90-44f9-af46-b9c842072898-istio-podinfo\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:10:12.842786 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:12.842551    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4887236-dd90-44f9-af46-b9c842072898-istio-token\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:10:13.223711 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:13.223680    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4887236-dd90-44f9-af46-b9c842072898" containerID="f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373" exitCode=0
Jul 24 19:10:13.223874 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:13.223732    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"
Jul 24 19:10:13.223874 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:13.223725    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" event={"ID":"d4887236-dd90-44f9-af46-b9c842072898","Type":"ContainerDied","Data":"f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373"}
Jul 24 19:10:13.223874 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:13.223858    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52" event={"ID":"d4887236-dd90-44f9-af46-b9c842072898","Type":"ContainerDied","Data":"1519951d66cd6d56628793590ac0f34a2c426cda8d06ed57ecd09e5d751b7823"}
Jul 24 19:10:13.223979 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:13.223891    2557 scope.go:117] "RemoveContainer" containerID="f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373"
Jul 24 19:10:13.233425 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:13.233409    2557 scope.go:117] "RemoveContainer" containerID="274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5"
Jul 24 19:10:13.241938 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:13.241919    2557 scope.go:117] "RemoveContainer" containerID="f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373"
Jul 24 19:10:13.242202 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:10:13.242184    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373\": container with ID starting with f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373 not found: ID does not exist" containerID="f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373"
Jul 24 19:10:13.242256 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:13.242211    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373"} err="failed to get container status \"f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373\": rpc error: code = NotFound desc = could not find container \"f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373\": container with ID starting with f7e3862199900258595deed35a03f5fe31c78ec75e7139582622eb77d42f2373 not found: ID does not exist"
Jul 24 19:10:13.242256 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:13.242231    2557 scope.go:117] "RemoveContainer" containerID="274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5"
Jul 24 19:10:13.242487 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:10:13.242465    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5\": container with ID starting with 274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5 not found: ID does not exist" containerID="274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5"
Jul 24 19:10:13.242549 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:13.242498    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5"} err="failed to get container status \"274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5\": rpc error: code = NotFound desc = could not find container \"274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5\": container with ID starting with 274743e5621608dd1d8031d7d77798fded684f071881c1988bf765621d5693e5 not found: ID does not exist"
Jul 24 19:10:13.248469 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:13.247581    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"]
Jul 24 19:10:13.253612 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:13.253578    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ff1b2177-openshift-default-7b6c96f76d-qvw52"]
Jul 24 19:10:14.621948 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:14.621903    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4887236-dd90-44f9-af46-b9c842072898" path="/var/lib/kubelet/pods/d4887236-dd90-44f9-af46-b9c842072898/volumes"
Jul 24 19:10:16.136569 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:16.136530    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:10:20.169211 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.169159    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b"]
Jul 24 19:10:20.170395 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.169967    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4887236-dd90-44f9-af46-b9c842072898" containerName="istio-proxy"
Jul 24 19:10:20.170395 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.169993    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4887236-dd90-44f9-af46-b9c842072898" containerName="istio-proxy"
Jul 24 19:10:20.170395 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.170005    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d7c2d6-92c1-485f-ac0c-e84cbf827a81" containerName="revoke-keys"
Jul 24 19:10:20.170395 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.170014    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d7c2d6-92c1-485f-ac0c-e84cbf827a81" containerName="revoke-keys"
Jul 24 19:10:20.170395 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.170056    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4887236-dd90-44f9-af46-b9c842072898" containerName="istio-proxy"
Jul 24 19:10:20.170395 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.170065    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4887236-dd90-44f9-af46-b9c842072898" containerName="istio-proxy"
Jul 24 19:10:20.170395 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.170234    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4887236-dd90-44f9-af46-b9c842072898" containerName="istio-proxy"
Jul 24 19:10:20.170395 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.170247    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="aadee062-58f0-49ff-8acd-5182be100ddd" containerName="istio-proxy"
Jul 24 19:10:20.170395 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.170262    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="85d7c2d6-92c1-485f-ac0c-e84cbf827a81" containerName="revoke-keys"
Jul 24 19:10:20.174880 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.174851    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b"
Jul 24 19:10:20.177814 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.177788    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:10:20.178364 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.178340    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:10:20.180389 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.180347    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b"]
Jul 24 19:10:20.208889 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.208846    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74690dfa-f317-46f0-9fa5-dec1dc65e57b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b\" (UID: \"74690dfa-f317-46f0-9fa5-dec1dc65e57b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b"
Jul 24 19:10:20.309425 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.309359    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74690dfa-f317-46f0-9fa5-dec1dc65e57b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b\" (UID: \"74690dfa-f317-46f0-9fa5-dec1dc65e57b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b"
Jul 24 19:10:20.309996 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.309974    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74690dfa-f317-46f0-9fa5-dec1dc65e57b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b\" (UID: \"74690dfa-f317-46f0-9fa5-dec1dc65e57b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b"
Jul 24 19:10:20.487649 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.487617    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b"
Jul 24 19:10:20.625158 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:20.625137    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b"]
Jul 24 19:10:20.627268 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:10:20.627239    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74690dfa_f317_46f0_9fa5_dec1dc65e57b.slice/crio-0a374829c6fce31ae05a5834f23cdd717be239732b5b7e2e8d4d01fc9ee1daf2 WatchSource:0}: Error finding container 0a374829c6fce31ae05a5834f23cdd717be239732b5b7e2e8d4d01fc9ee1daf2: Status 404 returned error can't find the container with id 0a374829c6fce31ae05a5834f23cdd717be239732b5b7e2e8d4d01fc9ee1daf2
Jul 24 19:10:21.266525 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:21.266487    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b" event={"ID":"74690dfa-f317-46f0-9fa5-dec1dc65e57b","Type":"ContainerStarted","Data":"ee7d1813c63f7825b5c894716f28254ec2e0566481a34e7123190a99698bc862"}
Jul 24 19:10:21.266983 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:21.266548    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b" event={"ID":"74690dfa-f317-46f0-9fa5-dec1dc65e57b","Type":"ContainerStarted","Data":"0a374829c6fce31ae05a5834f23cdd717be239732b5b7e2e8d4d01fc9ee1daf2"}
Jul 24 19:10:21.281714 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:21.281660    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b" podStartSLOduration=1.281643778 podStartE2EDuration="1.281643778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:10:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:10:21.28091952 +0000 UTC m=+1809.205872115" watchObservedRunningTime="2026-07-24 19:10:21.281643778 +0000 UTC m=+1809.206596372"
Jul 24 19:10:22.273344 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:22.273304    2557 generic.go:356] "Generic (PLEG): container finished" podID="74690dfa-f317-46f0-9fa5-dec1dc65e57b" containerID="ee7d1813c63f7825b5c894716f28254ec2e0566481a34e7123190a99698bc862" exitCode=0
Jul 24 19:10:22.273772 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:22.273400    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b" event={"ID":"74690dfa-f317-46f0-9fa5-dec1dc65e57b","Type":"ContainerDied","Data":"ee7d1813c63f7825b5c894716f28254ec2e0566481a34e7123190a99698bc862"}
Jul 24 19:10:23.410997 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:23.410972    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b"
Jul 24 19:10:23.430041 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:23.430009    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74690dfa-f317-46f0-9fa5-dec1dc65e57b-maas-api-service-ca\") pod \"74690dfa-f317-46f0-9fa5-dec1dc65e57b\" (UID: \"74690dfa-f317-46f0-9fa5-dec1dc65e57b\") "
Jul 24 19:10:23.430432 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:23.430409    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74690dfa-f317-46f0-9fa5-dec1dc65e57b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74690dfa-f317-46f0-9fa5-dec1dc65e57b" (UID: "74690dfa-f317-46f0-9fa5-dec1dc65e57b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:10:23.530723 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:23.530636    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74690dfa-f317-46f0-9fa5-dec1dc65e57b-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:10:24.284318 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:24.284283    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b"
Jul 24 19:10:24.284502 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:24.284319    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b" event={"ID":"74690dfa-f317-46f0-9fa5-dec1dc65e57b","Type":"ContainerDied","Data":"0a374829c6fce31ae05a5834f23cdd717be239732b5b7e2e8d4d01fc9ee1daf2"}
Jul 24 19:10:24.284502 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:24.284399    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a374829c6fce31ae05a5834f23cdd717be239732b5b7e2e8d4d01fc9ee1daf2"
Jul 24 19:10:30.861583 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:30.861546    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:30.930693 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:30.930660    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:31.032583 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:31.032536    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:33.924360 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:33.924317    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:10:35.242780 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:35.242743    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b"]
Jul 24 19:10:35.248121 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:35.248088    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a93f4b7c-hnn5b"]
Jul 24 19:10:35.253430 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:35.253410    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:35.412249 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:35.412206    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:35.629938 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:35.629849    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:36.104356 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:36.104311    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:36.202217 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:36.202188    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:36.304065 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:36.304031    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:36.621996 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:36.621962    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74690dfa-f317-46f0-9fa5-dec1dc65e57b" path="/var/lib/kubelet/pods/74690dfa-f317-46f0-9fa5-dec1dc65e57b/volumes"
Jul 24 19:10:37.702691 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:37.702656    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:43.533330 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:43.533293    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:43.635104 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:43.635067    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:43.732974 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:43.732944    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:43.848698 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:43.848612    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:44.203637 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:10:44.203549    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:10.162539 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:10.162504    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:16.641213 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:16.635560    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:16.739522 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:16.739490    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:16.835532 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:16.835498    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:16.935363 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:16.935286    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:32.707111 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:32.707074    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:38.607406 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:38.607294    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:38.672535 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:38.672495    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:38.765243 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:38.765210    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:38.866437 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:38.866342    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:40.196898 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:40.196863    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:40.250389 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:40.250353    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:49.321049 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:49.321015    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:50.100709 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:50.100671    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:56.230884 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:56.230836    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:56.338297 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:56.338262    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:56.438210 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:56.438175    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:56.531155 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:56.531076    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:57.271030 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:57.270979    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:57.366697 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:57.366661    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:57.467484 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:57.467454    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:59.076290 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:11:59.076261    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:01.024345 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:01.024307    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:12:05.515225 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:05.515191    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:05.614832 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:05.614797    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:06.256911 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:06.256882    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:10.222284 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:10.222246    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:12:12.031043 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.031009    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:12.131179 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.131150    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:12.274715 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.274680    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:12.562268 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.562234    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"]
Jul 24 19:12:12.562871 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.562853    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74690dfa-f317-46f0-9fa5-dec1dc65e57b" containerName="revoke-keys"
Jul 24 19:12:12.562935 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.562874    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="74690dfa-f317-46f0-9fa5-dec1dc65e57b" containerName="revoke-keys"
Jul 24 19:12:12.562972 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.562957    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="74690dfa-f317-46f0-9fa5-dec1dc65e57b" containerName="revoke-keys"
Jul 24 19:12:12.563006 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.562969    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4887236-dd90-44f9-af46-b9c842072898" containerName="istio-proxy"
Jul 24 19:12:12.566364 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.566344    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.569123 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.569105    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cf2d8fb2-openshift-default-dockercfg-xrfqq\""
Jul 24 19:12:12.580106 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.580079    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-credential-socket\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.580217 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.580139    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwlf4\" (UniqueName: \"kubernetes.io/projected/f49760c8-a3a4-4f07-9877-1aad24f4db6d-kube-api-access-jwlf4\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.580217 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.580180    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-workload-certs\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.580217 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.580195    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istiod-ca-cert\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.580326 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.580221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-envoy\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.580326 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.580304    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-token\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.580412 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.580355    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-podinfo\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.580449 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.580414    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-data\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.580449 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.580439    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-workload-socket\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.583826 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.583802    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"]
Jul 24 19:12:12.588907 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.588853    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:12.680902 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.680861    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-token\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.680902 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.680916    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-podinfo\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.681160 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.681075    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-data\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.681160 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.681121    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-workload-socket\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.681160 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.681147    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-credential-socket\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.681329 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.681230    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwlf4\" (UniqueName: \"kubernetes.io/projected/f49760c8-a3a4-4f07-9877-1aad24f4db6d-kube-api-access-jwlf4\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.681329 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.681285    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-workload-certs\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.681329 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.681307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istiod-ca-cert\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.681503 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.681339    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-envoy\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.681503 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.681461    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-data\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.681611 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.681509    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-workload-socket\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.681611 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.681576    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-credential-socket\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.681745 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.681720    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-workload-certs\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.682269 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.682220    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istiod-ca-cert\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.683988 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.683966    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-podinfo\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.684114 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.684095    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-envoy\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.690019 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.689999    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwlf4\" (UniqueName: \"kubernetes.io/projected/f49760c8-a3a4-4f07-9877-1aad24f4db6d-kube-api-access-jwlf4\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.690207 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.690190    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-token\") pod \"e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") " pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.877626 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.877537    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:12.899432 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:12.899397    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:13.045000 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:13.044971    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"]
Jul 24 19:12:13.046019 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:12:13.045995    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49760c8_a3a4_4f07_9877_1aad24f4db6d.slice/crio-3ea4a91a42615b89ec8af0500a5fb6007cc4e04b32797f04c8ef18036523f697 WatchSource:0}: Error finding container 3ea4a91a42615b89ec8af0500a5fb6007cc4e04b32797f04c8ef18036523f697: Status 404 returned error can't find the container with id 3ea4a91a42615b89ec8af0500a5fb6007cc4e04b32797f04c8ef18036523f697
Jul 24 19:12:13.048313 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:13.048279    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:12:13.048413 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:13.048346    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:12:13.048413 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:13.048395    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:12:13.825765 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:13.825731    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4" event={"ID":"f49760c8-a3a4-4f07-9877-1aad24f4db6d","Type":"ContainerStarted","Data":"1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3"}
Jul 24 19:12:13.825954 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:13.825784    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4" event={"ID":"f49760c8-a3a4-4f07-9877-1aad24f4db6d","Type":"ContainerStarted","Data":"3ea4a91a42615b89ec8af0500a5fb6007cc4e04b32797f04c8ef18036523f697"}
Jul 24 19:12:13.847503 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:13.847450    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4" podStartSLOduration=1.847431819 podStartE2EDuration="1.847431819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:12:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:12:13.84539172 +0000 UTC m=+1921.770344310" watchObservedRunningTime="2026-07-24 19:12:13.847431819 +0000 UTC m=+1921.772384412"
Jul 24 19:12:13.878085 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:13.878048    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:14.882570 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:14.882538    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:15.746315 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:15.746272    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:15.836165 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:15.836133    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:15.837043 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:15.837011    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:15.837172 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:15.837048    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:16.051804 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:16.051714    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:16.237638 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:16.237602    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:16.570611 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:16.570580    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:16.671712 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:16.671676    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:20.213093 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:20.213059    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:20.730543 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:20.730506    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:12:20.862102 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:20.862065    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:20.965617 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:20.965585    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:21.287424 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:21.287370    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:27.030241 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:27.030201    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:27.376951 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:27.376871    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj"]
Jul 24 19:12:27.380707 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:27.380685    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj"
Jul 24 19:12:27.383369 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:27.383339    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:12:27.383527 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:27.383445    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:12:27.393214 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:27.393169    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj"]
Jul 24 19:12:27.533923 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:27.533885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7582850a-b531-4925-9097-71f03a56d283-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj\" (UID: \"7582850a-b531-4925-9097-71f03a56d283\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj"
Jul 24 19:12:27.635160 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:27.635053    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7582850a-b531-4925-9097-71f03a56d283-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj\" (UID: \"7582850a-b531-4925-9097-71f03a56d283\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj"
Jul 24 19:12:27.635717 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:27.635696    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7582850a-b531-4925-9097-71f03a56d283-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj\" (UID: \"7582850a-b531-4925-9097-71f03a56d283\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj"
Jul 24 19:12:27.698514 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:27.698478    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj"
Jul 24 19:12:27.844222 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:27.844191    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj"]
Jul 24 19:12:27.846577 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:12:27.846548    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7582850a_b531_4925_9097_71f03a56d283.slice/crio-70f4bbf3efcd11695277cc1479b020d46384845222157032f55677ff55d33ce6 WatchSource:0}: Error finding container 70f4bbf3efcd11695277cc1479b020d46384845222157032f55677ff55d33ce6: Status 404 returned error can't find the container with id 70f4bbf3efcd11695277cc1479b020d46384845222157032f55677ff55d33ce6
Jul 24 19:12:27.898848 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:27.898772    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj" event={"ID":"7582850a-b531-4925-9097-71f03a56d283","Type":"ContainerStarted","Data":"70f4bbf3efcd11695277cc1479b020d46384845222157032f55677ff55d33ce6"}
Jul 24 19:12:28.432901 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:28.432865    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:28.905849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:28.905819    2557 generic.go:356] "Generic (PLEG): container finished" podID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerID="1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3" exitCode=0
Jul 24 19:12:28.906080 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:28.905900    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4" event={"ID":"f49760c8-a3a4-4f07-9877-1aad24f4db6d","Type":"ContainerDied","Data":"1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3"}
Jul 24 19:12:28.906366 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:28.906349    2557 scope.go:117] "RemoveContainer" containerID="1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3"
Jul 24 19:12:28.907502 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:28.907472    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:12:28.907611 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:28.907548    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:12:28.907611 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:28.907564    2557 generic.go:356] "Generic (PLEG): container finished" podID="7582850a-b531-4925-9097-71f03a56d283" containerID="e05b7233d6dfd2dfa262e1838ea91ef570c0dcf9d54998ac997b76c9a276e6fe" exitCode=0
Jul 24 19:12:28.907611 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:28.907591    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj" event={"ID":"7582850a-b531-4925-9097-71f03a56d283","Type":"ContainerDied","Data":"e05b7233d6dfd2dfa262e1838ea91ef570c0dcf9d54998ac997b76c9a276e6fe"}
Jul 24 19:12:28.907611 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:28.907606    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:12:29.918668 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:29.918610    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4" event={"ID":"f49760c8-a3a4-4f07-9877-1aad24f4db6d","Type":"ContainerStarted","Data":"74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b"}
Jul 24 19:12:30.075526 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:30.075493    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj"
Jul 24 19:12:30.161419 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:30.161352    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7582850a-b531-4925-9097-71f03a56d283-maas-api-service-ca\") pod \"7582850a-b531-4925-9097-71f03a56d283\" (UID: \"7582850a-b531-4925-9097-71f03a56d283\") "
Jul 24 19:12:30.161696 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:30.161672    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7582850a-b531-4925-9097-71f03a56d283-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7582850a-b531-4925-9097-71f03a56d283" (UID: "7582850a-b531-4925-9097-71f03a56d283"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:12:30.262517 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:30.262478    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7582850a-b531-4925-9097-71f03a56d283-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:12:30.836160 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:30.836128    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:30.878049 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:30.878017    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:30.879318 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:30.879281    2557 patch_prober.go:28] interesting pod/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:12:30.879485 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:30.879331    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4" podUID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 24 19:12:30.924486 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:30.924392    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj"
Jul 24 19:12:30.924486 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:30.924463    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj" event={"ID":"7582850a-b531-4925-9097-71f03a56d283","Type":"ContainerDied","Data":"70f4bbf3efcd11695277cc1479b020d46384845222157032f55677ff55d33ce6"}
Jul 24 19:12:30.925015 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:30.924516    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70f4bbf3efcd11695277cc1479b020d46384845222157032f55677ff55d33ce6"
Jul 24 19:12:31.878230 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:31.878192    2557 patch_prober.go:28] interesting pod/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:12:31.878479 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:31.878265    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4" podUID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 24 19:12:32.877936 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:32.877891    2557 patch_prober.go:28] interesting pod/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:12:32.878344 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:32.877957    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4" podUID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 24 19:12:33.882580 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:33.882545    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:33.883612 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:33.883589    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:37.819795 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:37.819758    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:37.883163 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:37.883110    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:37.942317 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:37.942284    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:41.026018 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:41.025984    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:12:42.448511 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:42.448475    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:42.453119 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:42.453089    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj"]
Jul 24 19:12:42.456341 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:42.456310    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cf2d8fb2-hkncj"]
Jul 24 19:12:42.621509 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:42.621480    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7582850a-b531-4925-9097-71f03a56d283" path="/var/lib/kubelet/pods/7582850a-b531-4925-9097-71f03a56d283/volumes"
Jul 24 19:12:42.876477 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:42.876439    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:48.457577 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:48.457543    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:48.558126 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:48.558090    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:48.715214 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:48.715180    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"]
Jul 24 19:12:48.715460 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:48.715434    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4" podUID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerName="istio-proxy" containerID="cri-o://74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b" gracePeriod=30
Jul 24 19:12:48.749848 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:48.749805    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:48.885194 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:48.885156    2557 patch_prober.go:28] interesting pod/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:12:48.885352 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:48.885218    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4" podUID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:12:49.015863 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:49.015767    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:49.141991 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:49.141955    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:49.222799 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:49.222765    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:49.324666 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:49.324577    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:53.975643 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.975615    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:53.981049 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.980993    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-credential-socket\") pod \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") "
Jul 24 19:12:53.981049 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981024    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-workload-certs\") pod \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") "
Jul 24 19:12:53.981049 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981045    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istiod-ca-cert\") pod \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") "
Jul 24 19:12:53.981278 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981084    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-data\") pod \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") "
Jul 24 19:12:53.981278 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981103    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-token\") pod \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") "
Jul 24 19:12:53.981278 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981137    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-envoy\") pod \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") "
Jul 24 19:12:53.981278 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981160    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-podinfo\") pod \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") "
Jul 24 19:12:53.981278 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981197    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-workload-socket\") pod \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") "
Jul 24 19:12:53.981278 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981233    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwlf4\" (UniqueName: \"kubernetes.io/projected/f49760c8-a3a4-4f07-9877-1aad24f4db6d-kube-api-access-jwlf4\") pod \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\" (UID: \"f49760c8-a3a4-4f07-9877-1aad24f4db6d\") "
Jul 24 19:12:53.981610 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981277    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f49760c8-a3a4-4f07-9877-1aad24f4db6d" (UID: "f49760c8-a3a4-4f07-9877-1aad24f4db6d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:12:53.981610 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981318    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f49760c8-a3a4-4f07-9877-1aad24f4db6d" (UID: "f49760c8-a3a4-4f07-9877-1aad24f4db6d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:12:53.981610 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981498    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f49760c8-a3a4-4f07-9877-1aad24f4db6d" (UID: "f49760c8-a3a4-4f07-9877-1aad24f4db6d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:12:53.981610 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981556    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f49760c8-a3a4-4f07-9877-1aad24f4db6d" (UID: "f49760c8-a3a4-4f07-9877-1aad24f4db6d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:12:53.981610 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981580    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-credential-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:12:53.981610 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981602    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-workload-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:12:53.981830 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.981617    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-workload-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:12:53.982133 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.982109    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f49760c8-a3a4-4f07-9877-1aad24f4db6d" (UID: "f49760c8-a3a4-4f07-9877-1aad24f4db6d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:12:53.983452 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.983410    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f49760c8-a3a4-4f07-9877-1aad24f4db6d" (UID: "f49760c8-a3a4-4f07-9877-1aad24f4db6d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:12:53.983559 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.983476    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f49760c8-a3a4-4f07-9877-1aad24f4db6d" (UID: "f49760c8-a3a4-4f07-9877-1aad24f4db6d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:12:53.983816 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.983797    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f49760c8-a3a4-4f07-9877-1aad24f4db6d" (UID: "f49760c8-a3a4-4f07-9877-1aad24f4db6d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:12:53.983899 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:53.983879    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f49760c8-a3a4-4f07-9877-1aad24f4db6d-kube-api-access-jwlf4" (OuterVolumeSpecName: "kube-api-access-jwlf4") pod "f49760c8-a3a4-4f07-9877-1aad24f4db6d" (UID: "f49760c8-a3a4-4f07-9877-1aad24f4db6d"). InnerVolumeSpecName "kube-api-access-jwlf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:12:54.053737 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.053696    2557 generic.go:356] "Generic (PLEG): container finished" podID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerID="74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b" exitCode=0
Jul 24 19:12:54.053930 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.053761    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"
Jul 24 19:12:54.053930 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.053783    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4" event={"ID":"f49760c8-a3a4-4f07-9877-1aad24f4db6d","Type":"ContainerDied","Data":"74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b"}
Jul 24 19:12:54.053930 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.053872    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4" event={"ID":"f49760c8-a3a4-4f07-9877-1aad24f4db6d","Type":"ContainerDied","Data":"3ea4a91a42615b89ec8af0500a5fb6007cc4e04b32797f04c8ef18036523f697"}
Jul 24 19:12:54.053930 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.053896    2557 scope.go:117] "RemoveContainer" containerID="74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b"
Jul 24 19:12:54.063841 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.063816    2557 scope.go:117] "RemoveContainer" containerID="1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3"
Jul 24 19:12:54.072227 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.072206    2557 scope.go:117] "RemoveContainer" containerID="74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b"
Jul 24 19:12:54.072511 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:12:54.072494    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b\": container with ID starting with 74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b not found: ID does not exist" containerID="74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b"
Jul 24 19:12:54.072566 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.072518    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b"} err="failed to get container status \"74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b\": rpc error: code = NotFound desc = could not find container \"74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b\": container with ID starting with 74a856a8929de59c33fd8c7a1b767ded162db4507fe4efff70a83577aff91d3b not found: ID does not exist"
Jul 24 19:12:54.072566 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.072534    2557 scope.go:117] "RemoveContainer" containerID="1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3"
Jul 24 19:12:54.072744 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:12:54.072729    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3\": container with ID starting with 1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3 not found: ID does not exist" containerID="1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3"
Jul 24 19:12:54.072785 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.072746    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3"} err="failed to get container status \"1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3\": rpc error: code = NotFound desc = could not find container \"1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3\": container with ID starting with 1511e66ed7b1d650879ce3b879b344ff6cb5ae9d3db81b45cdda2d1ab112f5e3 not found: ID does not exist"
Jul 24 19:12:54.077744 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.077718    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"]
Jul 24 19:12:54.081734 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.081708    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cf2d8fb2-openshift-default-54b58575b8-rtmw4"]
Jul 24 19:12:54.082014 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.081997    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-envoy\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:12:54.082065 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.082017    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-podinfo\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:12:54.082065 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.082026    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwlf4\" (UniqueName: \"kubernetes.io/projected/f49760c8-a3a4-4f07-9877-1aad24f4db6d-kube-api-access-jwlf4\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:12:54.082065 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.082036    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istiod-ca-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:12:54.082065 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.082044    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-data\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:12:54.082065 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.082052    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f49760c8-a3a4-4f07-9877-1aad24f4db6d-istio-token\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:12:54.622056 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:54.622023    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" path="/var/lib/kubelet/pods/f49760c8-a3a4-4f07-9877-1aad24f4db6d/volumes"
Jul 24 19:12:55.169101 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:55.169061    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:55.230941 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:55.230901    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:55.307435 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:55.307404    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:55.422803 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:55.422713    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:55.584894 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:12:55.584859    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:01.202129 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:01.202097    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:01.261668 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:01.261630    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:07.938450 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:07.938342    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:08.322120 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.322086    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"]
Jul 24 19:13:08.322490 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.322477    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerName="istio-proxy"
Jul 24 19:13:08.322560 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.322491    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerName="istio-proxy"
Jul 24 19:13:08.322560 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.322502    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7582850a-b531-4925-9097-71f03a56d283" containerName="revoke-keys"
Jul 24 19:13:08.322560 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.322507    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7582850a-b531-4925-9097-71f03a56d283" containerName="revoke-keys"
Jul 24 19:13:08.322560 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.322520    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerName="istio-proxy"
Jul 24 19:13:08.322560 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.322526    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerName="istio-proxy"
Jul 24 19:13:08.322753 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.322583    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerName="istio-proxy"
Jul 24 19:13:08.322753 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.322591    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7582850a-b531-4925-9097-71f03a56d283" containerName="revoke-keys"
Jul 24 19:13:08.322753 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.322597    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49760c8-a3a4-4f07-9877-1aad24f4db6d" containerName="istio-proxy"
Jul 24 19:13:08.325553 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.325534    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.330907 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.330881    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-780ac09a-openshift-default-dockercfg-hzc94\""
Jul 24 19:13:08.354245 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.354201    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"]
Jul 24 19:13:08.366397 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.366340    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:08.394133 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.394099    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-podinfo\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.394133 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.394135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istiod-ca-cert\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.394421 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.394163    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-data\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.394421 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.394239    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-workload-socket\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.394421 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.394268    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-credential-socket\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.394421 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.394357    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-token\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.394647 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.394436    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdlbh\" (UniqueName: \"kubernetes.io/projected/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-kube-api-access-wdlbh\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.394647 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.394491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-envoy\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.394647 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.394522    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-workload-certs\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.495604 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.495567    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-envoy\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.495808 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.495614    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-workload-certs\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.495808 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.495672    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-podinfo\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.495808 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.495696    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istiod-ca-cert\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.495808 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.495726    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-data\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.495808 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.495764    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-workload-socket\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.495808 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.495786    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-credential-socket\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.496142 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.495833    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-token\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.496142 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.495871    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdlbh\" (UniqueName: \"kubernetes.io/projected/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-kube-api-access-wdlbh\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.496142 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.496091    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-workload-certs\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.496464 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.496291    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-workload-socket\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.496464 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.496399    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-credential-socket\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.496666 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.496628    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-data\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.496754 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.496728    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istiod-ca-cert\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.498221 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.498189    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-envoy\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.498929 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.498903    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-podinfo\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.504891 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.504864    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-token\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.505026 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.504903    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdlbh\" (UniqueName: \"kubernetes.io/projected/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-kube-api-access-wdlbh\") pod \"e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") " pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.637096 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.636992    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:08.786911 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.786884    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"]
Jul 24 19:13:08.789618 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:13:08.789589    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c78f34_c7ab_440c_ace7_27edb8e66f6a.slice/crio-68d963ff465a1559adbe54ff6820347eb9388b4b9ae0b1374e7aa30d184d7f14 WatchSource:0}: Error finding container 68d963ff465a1559adbe54ff6820347eb9388b4b9ae0b1374e7aa30d184d7f14: Status 404 returned error can't find the container with id 68d963ff465a1559adbe54ff6820347eb9388b4b9ae0b1374e7aa30d184d7f14
Jul 24 19:13:08.792288 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.792244    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:13:08.792400 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.792335    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:13:08.792400 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.792362    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:13:08.805639 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:08.805596    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:09.141792 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:09.141756    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" event={"ID":"f8c78f34-c7ab-440c-ace7-27edb8e66f6a","Type":"ContainerStarted","Data":"01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2"}
Jul 24 19:13:09.142194 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:09.141815    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" event={"ID":"f8c78f34-c7ab-440c-ace7-27edb8e66f6a","Type":"ContainerStarted","Data":"68d963ff465a1559adbe54ff6820347eb9388b4b9ae0b1374e7aa30d184d7f14"}
Jul 24 19:13:09.163125 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:09.163068    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" podStartSLOduration=1.163051046 podStartE2EDuration="1.163051046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:13:09.16270679 +0000 UTC m=+1977.087659384" watchObservedRunningTime="2026-07-24 19:13:09.163051046 +0000 UTC m=+1977.088003640"
Jul 24 19:13:09.637884 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:09.637844    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:09.643037 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:09.643011    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:10.150150 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:10.150118    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:10.151155 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:10.151137    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:11.062599 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:11.062563    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:11.154264 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:11.154226    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:11.320000 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:11.319915    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:11.551438 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:11.551402    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:11.806274 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:11.806242    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:11.910312 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:11.910269    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:15.538165 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:15.538127    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:15.620341 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:15.620306    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:13:21.883361 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:21.883312    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:24.225112 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:24.225077    2557 generic.go:356] "Generic (PLEG): container finished" podID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerID="01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2" exitCode=0
Jul 24 19:13:24.225572 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:24.225151    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" event={"ID":"f8c78f34-c7ab-440c-ace7-27edb8e66f6a","Type":"ContainerDied","Data":"01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2"}
Jul 24 19:13:24.225651 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:24.225633    2557 scope.go:117] "RemoveContainer" containerID="01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2"
Jul 24 19:13:24.226788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:24.226761    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:13:24.226854 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:24.226834    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:13:24.226890 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:24.226868    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:13:25.150552 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:25.150511    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:25.232372 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:25.232338    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" event={"ID":"f8c78f34-c7ab-440c-ace7-27edb8e66f6a","Type":"ContainerStarted","Data":"c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33"}
Jul 24 19:13:25.637780 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:25.637749    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:25.638940 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:25.638911    2557 patch_prober.go:28] interesting pod/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 19:13:25.639076 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:25.638961    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 19:13:26.353079 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:26.353042    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:13:26.637983 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:26.637898    2557 patch_prober.go:28] interesting pod/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 19:13:26.637983 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:26.637957    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 19:13:27.637992 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:27.637947    2557 patch_prober.go:28] interesting pod/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 19:13:27.638511 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:27.638007    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 19:13:28.637747 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:28.637703    2557 patch_prober.go:28] interesting pod/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 19:13:28.637931 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:28.637764    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 19:13:29.641917 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:29.641883    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:29.642355 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:29.642296    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:29.642973 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:29.642951    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:13:55.730268 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:13:55.730231    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:14:00.025019 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:00.024977    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g"]
Jul 24 19:14:00.027257 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:00.027240    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g"
Jul 24 19:14:00.029617 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:00.029596    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:14:00.029617 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:00.029614    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:14:00.034434 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:00.034410    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g"]
Jul 24 19:14:00.066710 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:00.066674    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea8e884-c3af-47bd-9ca8-d8997f3ad96c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-780ac09a-nps6g\" (UID: \"dea8e884-c3af-47bd-9ca8-d8997f3ad96c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g"
Jul 24 19:14:00.167361 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:00.167318    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea8e884-c3af-47bd-9ca8-d8997f3ad96c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-780ac09a-nps6g\" (UID: \"dea8e884-c3af-47bd-9ca8-d8997f3ad96c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g"
Jul 24 19:14:00.167973 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:00.167951    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea8e884-c3af-47bd-9ca8-d8997f3ad96c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-780ac09a-nps6g\" (UID: \"dea8e884-c3af-47bd-9ca8-d8997f3ad96c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g"
Jul 24 19:14:00.347703 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:00.347603    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g"
Jul 24 19:14:00.481214 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:00.481085    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g"]
Jul 24 19:14:00.483396 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:14:00.483352    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea8e884_c3af_47bd_9ca8_d8997f3ad96c.slice/crio-6260bd07fc19dd72c7fbbdfcb4920ef703b73efc397d8f1d9096d53fabe19473 WatchSource:0}: Error finding container 6260bd07fc19dd72c7fbbdfcb4920ef703b73efc397d8f1d9096d53fabe19473: Status 404 returned error can't find the container with id 6260bd07fc19dd72c7fbbdfcb4920ef703b73efc397d8f1d9096d53fabe19473
Jul 24 19:14:01.413744 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:01.413709    2557 generic.go:356] "Generic (PLEG): container finished" podID="dea8e884-c3af-47bd-9ca8-d8997f3ad96c" containerID="3a75f80aa45e69b0521122d6487eb51c7ff3775172a7535617efd4338117b27d" exitCode=0
Jul 24 19:14:01.414146 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:01.413788    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g" event={"ID":"dea8e884-c3af-47bd-9ca8-d8997f3ad96c","Type":"ContainerDied","Data":"3a75f80aa45e69b0521122d6487eb51c7ff3775172a7535617efd4338117b27d"}
Jul 24 19:14:01.414146 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:01.413835    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g" event={"ID":"dea8e884-c3af-47bd-9ca8-d8997f3ad96c","Type":"ContainerStarted","Data":"6260bd07fc19dd72c7fbbdfcb4920ef703b73efc397d8f1d9096d53fabe19473"}
Jul 24 19:14:02.556438 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:02.556413    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g"
Jul 24 19:14:02.589835 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:02.589805    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea8e884-c3af-47bd-9ca8-d8997f3ad96c-maas-api-service-ca\") pod \"dea8e884-c3af-47bd-9ca8-d8997f3ad96c\" (UID: \"dea8e884-c3af-47bd-9ca8-d8997f3ad96c\") "
Jul 24 19:14:02.590145 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:02.590119    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dea8e884-c3af-47bd-9ca8-d8997f3ad96c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dea8e884-c3af-47bd-9ca8-d8997f3ad96c" (UID: "dea8e884-c3af-47bd-9ca8-d8997f3ad96c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:14:02.690654 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:02.690563    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dea8e884-c3af-47bd-9ca8-d8997f3ad96c-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:14:03.425447 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:03.425410    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g" event={"ID":"dea8e884-c3af-47bd-9ca8-d8997f3ad96c","Type":"ContainerDied","Data":"6260bd07fc19dd72c7fbbdfcb4920ef703b73efc397d8f1d9096d53fabe19473"}
Jul 24 19:14:03.425619 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:03.425476    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6260bd07fc19dd72c7fbbdfcb4920ef703b73efc397d8f1d9096d53fabe19473"
Jul 24 19:14:03.425619 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:03.425424    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g"
Jul 24 19:14:14.371255 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:14.371213    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:14:15.691168 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:15.691132    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:15.760773 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:15.760736    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:15.859876 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:15.859840    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:20.113233 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:20.113197    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g"]
Jul 24 19:14:20.116536 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:20.116500    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-780ac09a-nps6g"]
Jul 24 19:14:20.119459 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:20.119432    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:20.623180 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:20.623141    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dea8e884-c3af-47bd-9ca8-d8997f3ad96c" path="/var/lib/kubelet/pods/dea8e884-c3af-47bd-9ca8-d8997f3ad96c/volumes"
Jul 24 19:14:22.726936 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:22.726897    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:14:23.284965 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:23.284931    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:28.364486 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:28.364453    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:46.530747 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:46.530662    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:48.223837 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:14:48.223787    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:00.144153 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:00.144117    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748675-25chd"]
Jul 24 19:15:00.144683 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:00.144514    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dea8e884-c3af-47bd-9ca8-d8997f3ad96c" containerName="revoke-keys"
Jul 24 19:15:00.144683 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:00.144530    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dea8e884-c3af-47bd-9ca8-d8997f3ad96c" containerName="revoke-keys"
Jul 24 19:15:00.144683 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:00.144589    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dea8e884-c3af-47bd-9ca8-d8997f3ad96c" containerName="revoke-keys"
Jul 24 19:15:00.147585 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:00.147567    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748675-25chd"
Jul 24 19:15:00.150748 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:00.150715    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:15:00.157966 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:00.157932    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748675-25chd"]
Jul 24 19:15:00.165356 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:00.165329    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748675-25chd"
Jul 24 19:15:00.306090 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:00.306064    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748675-25chd"]
Jul 24 19:15:00.308259 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:15:00.308228    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5778dd59_5d08_4bb0_b32a_b623e01b5876.slice/crio-c2afc50687d0c75a6b510f46ffb695f946ea0aed3cdc1d04060cc409a4a7970f WatchSource:0}: Error finding container c2afc50687d0c75a6b510f46ffb695f946ea0aed3cdc1d04060cc409a4a7970f: Status 404 returned error can't find the container with id c2afc50687d0c75a6b510f46ffb695f946ea0aed3cdc1d04060cc409a4a7970f
Jul 24 19:15:00.713433 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:00.713395    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748675-25chd" event={"ID":"5778dd59-5d08-4bb0-b32a-b623e01b5876","Type":"ContainerStarted","Data":"9479aa8a35878cb78c666e23b0a2b266f0abc6ca1d8a94c91bc770d8888e7926"}
Jul 24 19:15:00.713610 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:00.713451    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748675-25chd" event={"ID":"5778dd59-5d08-4bb0-b32a-b623e01b5876","Type":"ContainerStarted","Data":"c2afc50687d0c75a6b510f46ffb695f946ea0aed3cdc1d04060cc409a4a7970f"}
Jul 24 19:15:00.729135 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:00.729081    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748675-25chd" podStartSLOduration=0.729066125 podStartE2EDuration="729.066125ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:15:00.726536651 +0000 UTC m=+2088.651489450" watchObservedRunningTime="2026-07-24 19:15:00.729066125 +0000 UTC m=+2088.654018719"
Jul 24 19:15:01.720007 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:01.719965    2557 generic.go:356] "Generic (PLEG): container finished" podID="5778dd59-5d08-4bb0-b32a-b623e01b5876" containerID="9479aa8a35878cb78c666e23b0a2b266f0abc6ca1d8a94c91bc770d8888e7926" exitCode=0
Jul 24 19:15:01.720465 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:01.720037    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748675-25chd" event={"ID":"5778dd59-5d08-4bb0-b32a-b623e01b5876","Type":"ContainerDied","Data":"9479aa8a35878cb78c666e23b0a2b266f0abc6ca1d8a94c91bc770d8888e7926"}
Jul 24 19:15:02.860467 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:02.860439    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748675-25chd"
Jul 24 19:15:03.731592 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:03.731566    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748675-25chd"
Jul 24 19:15:03.731757 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:03.731604    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748675-25chd" event={"ID":"5778dd59-5d08-4bb0-b32a-b623e01b5876","Type":"ContainerDied","Data":"c2afc50687d0c75a6b510f46ffb695f946ea0aed3cdc1d04060cc409a4a7970f"}
Jul 24 19:15:03.731757 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:03.731646    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2afc50687d0c75a6b510f46ffb695f946ea0aed3cdc1d04060cc409a4a7970f"
Jul 24 19:15:04.935019 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:04.934966    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:05.355950 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:05.355915    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:10.912069 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:10.912036    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:10.972867 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:10.972830    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:11.156543 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:11.156500    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"]
Jul 24 19:15:11.156743 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:11.156706    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerName="istio-proxy" containerID="cri-o://c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33" gracePeriod=30
Jul 24 19:15:11.187447 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:11.187309    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:11.407457 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:11.407426    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:12.462083 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:12.462050    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:12.565689 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:12.565658    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:12.666946 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:12.666916    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:12.712825 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:12.712742    2557 scope.go:117] "RemoveContainer" containerID="cecbd37bdbb959ea1dd10eb25b11f8d635b3fd4cbeb8132ae646dd6f662df190"
Jul 24 19:15:12.721093 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:12.721070    2557 scope.go:117] "RemoveContainer" containerID="577ee69a7e8f6892ceaef910c4a39b1f48abcb5108c9ad86ac49420145b407a6"
Jul 24 19:15:13.394626 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:13.394590    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:13.572476 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:13.572432    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:14.643866 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:14.643833    2557 patch_prober.go:28] interesting pod/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:15:14.644252 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:14.643885    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:15:14.835082 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:14.835042    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:15:15.018238 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:15.018201    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:16.407838 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.407808    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:15:16.546290 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546249    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-podinfo\") pod \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") "
Jul 24 19:15:16.546290 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546292    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-workload-socket\") pod \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") "
Jul 24 19:15:16.546585 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546317    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istiod-ca-cert\") pod \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") "
Jul 24 19:15:16.546585 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546344    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdlbh\" (UniqueName: \"kubernetes.io/projected/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-kube-api-access-wdlbh\") pod \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") "
Jul 24 19:15:16.546585 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546408    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-token\") pod \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") "
Jul 24 19:15:16.546585 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546464    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-workload-certs\") pod \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") "
Jul 24 19:15:16.546585 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546516    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-envoy\") pod \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") "
Jul 24 19:15:16.546585 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546546    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-credential-socket\") pod \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") "
Jul 24 19:15:16.546585 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546581    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-data\") pod \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\" (UID: \"f8c78f34-c7ab-440c-ace7-27edb8e66f6a\") "
Jul 24 19:15:16.547003 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546657    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f8c78f34-c7ab-440c-ace7-27edb8e66f6a" (UID: "f8c78f34-c7ab-440c-ace7-27edb8e66f6a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:15:16.547003 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546735    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f8c78f34-c7ab-440c-ace7-27edb8e66f6a" (UID: "f8c78f34-c7ab-440c-ace7-27edb8e66f6a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:15:16.547003 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546817    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f8c78f34-c7ab-440c-ace7-27edb8e66f6a" (UID: "f8c78f34-c7ab-440c-ace7-27edb8e66f6a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:15:16.547003 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546916    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f8c78f34-c7ab-440c-ace7-27edb8e66f6a" (UID: "f8c78f34-c7ab-440c-ace7-27edb8e66f6a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:15:16.547003 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546964    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-workload-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:15:16.547003 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.546989    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istiod-ca-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:15:16.547003 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.547003    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-workload-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:15:16.547610 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.547588    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-data" (OuterVolumeSpecName: "istio-data") pod "f8c78f34-c7ab-440c-ace7-27edb8e66f6a" (UID: "f8c78f34-c7ab-440c-ace7-27edb8e66f6a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:15:16.548806 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.548783    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f8c78f34-c7ab-440c-ace7-27edb8e66f6a" (UID: "f8c78f34-c7ab-440c-ace7-27edb8e66f6a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:15:16.548907 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.548842    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-kube-api-access-wdlbh" (OuterVolumeSpecName: "kube-api-access-wdlbh") pod "f8c78f34-c7ab-440c-ace7-27edb8e66f6a" (UID: "f8c78f34-c7ab-440c-ace7-27edb8e66f6a"). InnerVolumeSpecName "kube-api-access-wdlbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:15:16.549064 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.549037    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-token" (OuterVolumeSpecName: "istio-token") pod "f8c78f34-c7ab-440c-ace7-27edb8e66f6a" (UID: "f8c78f34-c7ab-440c-ace7-27edb8e66f6a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:15:16.549134 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.549079    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f8c78f34-c7ab-440c-ace7-27edb8e66f6a" (UID: "f8c78f34-c7ab-440c-ace7-27edb8e66f6a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:15:16.647966 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.647942    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-data\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:15:16.647966 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.647966    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-podinfo\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:15:16.648116 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.647992    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdlbh\" (UniqueName: \"kubernetes.io/projected/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-kube-api-access-wdlbh\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:15:16.648116 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.648002    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-token\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:15:16.648116 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.648010    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-istio-envoy\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:15:16.648116 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.648018    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c78f34-c7ab-440c-ace7-27edb8e66f6a-credential-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:15:16.800537 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.800436    2557 generic.go:356] "Generic (PLEG): container finished" podID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerID="c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33" exitCode=0
Jul 24 19:15:16.800537 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.800496    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"
Jul 24 19:15:16.800537 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.800513    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" event={"ID":"f8c78f34-c7ab-440c-ace7-27edb8e66f6a","Type":"ContainerDied","Data":"c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33"}
Jul 24 19:15:16.800826 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.800562    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh" event={"ID":"f8c78f34-c7ab-440c-ace7-27edb8e66f6a","Type":"ContainerDied","Data":"68d963ff465a1559adbe54ff6820347eb9388b4b9ae0b1374e7aa30d184d7f14"}
Jul 24 19:15:16.800826 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.800587    2557 scope.go:117] "RemoveContainer" containerID="c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33"
Jul 24 19:15:16.809271 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.809252    2557 scope.go:117] "RemoveContainer" containerID="01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2"
Jul 24 19:15:16.820505 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.820477    2557 scope.go:117] "RemoveContainer" containerID="c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33"
Jul 24 19:15:16.821003 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:15:16.820970    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33\": container with ID starting with c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33 not found: ID does not exist" containerID="c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33"
Jul 24 19:15:16.821110 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.821005    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33"} err="failed to get container status \"c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33\": rpc error: code = NotFound desc = could not find container \"c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33\": container with ID starting with c1d455a22d2e2d931ef13a9412f74aed3ec5766a0073f0260072b6c3ed236f33 not found: ID does not exist"
Jul 24 19:15:16.821110 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.821031    2557 scope.go:117] "RemoveContainer" containerID="01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2"
Jul 24 19:15:16.821395 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:15:16.821353    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2\": container with ID starting with 01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2 not found: ID does not exist" containerID="01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2"
Jul 24 19:15:16.821458 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.821405    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2"} err="failed to get container status \"01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2\": rpc error: code = NotFound desc = could not find container \"01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2\": container with ID starting with 01fe494b1c9d40abeec91f24b8146bff74d3a713e8dbe56a087f70e14d5f4df2 not found: ID does not exist"
Jul 24 19:15:16.822778 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.822759    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"]
Jul 24 19:15:16.826585 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:16.826562    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-780ac09a-openshift-default-5bd8f79f76-tvhxh"]
Jul 24 19:15:18.622111 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:18.622065    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" path="/var/lib/kubelet/pods/f8c78f34-c7ab-440c-ace7-27edb8e66f6a/volumes"
Jul 24 19:15:21.080707 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:21.080673    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:21.180092 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:21.180060    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:21.740762 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:21.740727    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:24.536511 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:24.536476    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:15:28.098275 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:28.098236    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:28.211280 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:28.211243    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:28.295994 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:28.295958    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:35.882801 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:35.882762    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:38.782191 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:38.782148    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:39.115694 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:15:39.115598    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:00.061441 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:00.061407    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:06.485655 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:06.485572    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:06.592300 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:06.592267    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:06.821827 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:06.821743    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:07.105100 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.105012    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"]
Jul 24 19:16:07.105410 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.105396    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5778dd59-5d08-4bb0-b32a-b623e01b5876" containerName="cleanup"
Jul 24 19:16:07.105487 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.105411    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5778dd59-5d08-4bb0-b32a-b623e01b5876" containerName="cleanup"
Jul 24 19:16:07.105487 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.105433    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerName="istio-proxy"
Jul 24 19:16:07.105487 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.105439    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerName="istio-proxy"
Jul 24 19:16:07.105487 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.105446    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerName="istio-proxy"
Jul 24 19:16:07.105487 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.105452    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerName="istio-proxy"
Jul 24 19:16:07.105740 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.105510    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerName="istio-proxy"
Jul 24 19:16:07.105740 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.105519    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c78f34-c7ab-440c-ace7-27edb8e66f6a" containerName="istio-proxy"
Jul 24 19:16:07.105740 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.105527    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5778dd59-5d08-4bb0-b32a-b623e01b5876" containerName="cleanup"
Jul 24 19:16:07.108949 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.108924    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.111341 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.111316    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2ee838-openshift-default-dockercfg-llfrh\""
Jul 24 19:16:07.125313 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.125285    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"]
Jul 24 19:16:07.132346 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.132313    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:07.187545 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.187509    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-envoy\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.187545 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.187551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-data\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.187780 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.187580    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-workload-socket\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.187780 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.187675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-credential-socket\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.187780 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.187716    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3050ddb-c7b4-4959-abaf-298cb07d775f-istiod-ca-cert\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.187917 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.187790    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gscbr\" (UniqueName: \"kubernetes.io/projected/c3050ddb-c7b4-4959-abaf-298cb07d775f-kube-api-access-gscbr\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.187917 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.187816    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-podinfo\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.187917 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.187845    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-token\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.187917 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.187866    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-workload-certs\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.288766 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.288723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-envoy\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.288766 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.288763    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-data\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.289011 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.288781    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-workload-socket\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.289011 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.288812    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-credential-socket\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.289011 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.288948    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3050ddb-c7b4-4959-abaf-298cb07d775f-istiod-ca-cert\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.289170 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.289043    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gscbr\" (UniqueName: \"kubernetes.io/projected/c3050ddb-c7b4-4959-abaf-298cb07d775f-kube-api-access-gscbr\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.289170 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.289074    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-podinfo\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.289170 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.289118    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-token\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.289170 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.289149    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-workload-certs\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.289418 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.289213    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-data\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.289418 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.289267    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-workload-socket\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.289418 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.289290    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-credential-socket\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.289593 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.289530    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-workload-certs\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.289783 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.289760    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3050ddb-c7b4-4959-abaf-298cb07d775f-istiod-ca-cert\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.291175 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.291153    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-envoy\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.291680 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.291659    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-podinfo\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.299222 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.299198    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gscbr\" (UniqueName: \"kubernetes.io/projected/c3050ddb-c7b4-4959-abaf-298cb07d775f-kube-api-access-gscbr\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.299327 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.299205    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-token\") pod \"e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") " pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.372624 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.372507    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:07.419696 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.419659    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:07.568720 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.565250    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"]
Jul 24 19:16:07.573129 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:16:07.573099    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3050ddb_c7b4_4959_abaf_298cb07d775f.slice/crio-042634253a6d5d8de20ae46783eeb702e85f653ad957de63d2116ca947566390 WatchSource:0}: Error finding container 042634253a6d5d8de20ae46783eeb702e85f653ad957de63d2116ca947566390: Status 404 returned error can't find the container with id 042634253a6d5d8de20ae46783eeb702e85f653ad957de63d2116ca947566390
Jul 24 19:16:07.575241 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.575208    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:16:07.575314 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.575278    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:16:07.575314 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:07.575308    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:16:08.061152 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:08.061111    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" event={"ID":"c3050ddb-c7b4-4959-abaf-298cb07d775f","Type":"ContainerStarted","Data":"1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858"}
Jul 24 19:16:08.061370 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:08.061173    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" event={"ID":"c3050ddb-c7b4-4959-abaf-298cb07d775f","Type":"ContainerStarted","Data":"042634253a6d5d8de20ae46783eeb702e85f653ad957de63d2116ca947566390"}
Jul 24 19:16:08.083214 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:08.083157    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" podStartSLOduration=1.083139853 podStartE2EDuration="1.083139853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:16:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:16:08.081300681 +0000 UTC m=+2156.006253275" watchObservedRunningTime="2026-07-24 19:16:08.083139853 +0000 UTC m=+2156.008092689"
Jul 24 19:16:08.420040 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:08.419952    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:08.424822 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:08.424796    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:09.065769 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:09.065736    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:09.066752 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:09.066731    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:10.008988 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:10.008934    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:10.106565 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:10.106526    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:10.224101 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:10.224066    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:10.774180 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:10.774146    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:10.869733 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:10.869695    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:12.743520 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:12.743484    2557 scope.go:117] "RemoveContainer" containerID="e9c3ed61b182a38857a77607989e104e4fabadceda63622c732f3ff6e7774aa0"
Jul 24 19:16:14.485291 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:14.485244    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:14.813142 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:14.813050    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:15.068333 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.068257    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"]
Jul 24 19:16:15.073508 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.073482    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.076005 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.075984    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-31c4fa-openshift-default-dockercfg-lwmm5\""
Jul 24 19:16:15.084822 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.084776    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"]
Jul 24 19:16:15.107402 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.107345    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:15.259182 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.259143    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf7dm\" (UniqueName: \"kubernetes.io/projected/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-kube-api-access-jf7dm\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.259182 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.259182    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istiod-ca-cert\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.259478 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.259208    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-credential-socket\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.259478 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.259274    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-envoy\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.259478 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.259289    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-token\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.259478 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.259330    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-workload-certs\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.259478 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.259347    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-data\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.259478 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.259409    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-podinfo\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.259478 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.259437    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-workload-socket\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.286899 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.286865    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:15.360328 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.360233    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-workload-certs\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.360328 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.360273    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-data\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.360328 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.360316    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-podinfo\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.360645 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.360354    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-workload-socket\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.360645 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.360446    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf7dm\" (UniqueName: \"kubernetes.io/projected/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-kube-api-access-jf7dm\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.360645 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.360476    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istiod-ca-cert\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.360645 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.360616    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-credential-socket\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.360869 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.360686    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-envoy\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.360869 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.360710    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-token\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.360869 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.360720    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-workload-certs\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.360869 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.360776    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-data\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.360869 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.360808    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-workload-socket\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.361144 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.361080    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-credential-socket\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.361263 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.361244    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istiod-ca-cert\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.362853 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.362830    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-podinfo\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.362913 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.362876    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-envoy\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.368849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.368823    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-token\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.369412 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.369392    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf7dm\" (UniqueName: \"kubernetes.io/projected/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-kube-api-access-jf7dm\") pod \"e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") " pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.386430 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.386405    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:15.526139 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.526107    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"]
Jul 24 19:16:15.528166 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:16:15.528136    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e043dcb_2259_42b9_a2a1_7bc5b3a00a23.slice/crio-7c472880f4dbd39eaafb52519bb2890015ee02ab9acd9e2365bbe0894b04e0c7 WatchSource:0}: Error finding container 7c472880f4dbd39eaafb52519bb2890015ee02ab9acd9e2365bbe0894b04e0c7: Status 404 returned error can't find the container with id 7c472880f4dbd39eaafb52519bb2890015ee02ab9acd9e2365bbe0894b04e0c7
Jul 24 19:16:15.528371 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.528353    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:16:15.530337 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.530310    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:16:15.530418 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.530369    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:16:15.530464 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:15.530416    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:16:16.101060 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:16.101023    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" event={"ID":"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23","Type":"ContainerStarted","Data":"75a770af185e3bdfda3631d65e622f50fb2629f5f3e393dec65207b93e719ff8"}
Jul 24 19:16:16.101267 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:16.101082    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" event={"ID":"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23","Type":"ContainerStarted","Data":"7c472880f4dbd39eaafb52519bb2890015ee02ab9acd9e2365bbe0894b04e0c7"}
Jul 24 19:16:16.133397 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:16.133325    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" podStartSLOduration=1.13330813 podStartE2EDuration="1.13330813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:16:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:16:16.130880927 +0000 UTC m=+2164.055833524" watchObservedRunningTime="2026-07-24 19:16:16.13330813 +0000 UTC m=+2164.058260723"
Jul 24 19:16:16.387080 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:16.386993    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:16.391903 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:16.391873    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:17.111322 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:17.111290    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:17.117899 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:17.117875    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:18.049511 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:18.049472    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:18.152129 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:18.152092    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:18.250131 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:18.250099    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:18.381604 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:18.381519    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:18.729155 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:18.729118    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:18.826964 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:18.826930    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:22.532684 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:22.532641    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:24.067564 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:24.067479    2557 patch_prober.go:28] interesting pod/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 19:16:24.067564 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:24.067536    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 19:16:24.153697 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:24.153594    2557 generic.go:356] "Generic (PLEG): container finished" podID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerID="1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858" exitCode=0
Jul 24 19:16:24.153697 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:24.153664    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" event={"ID":"c3050ddb-c7b4-4959-abaf-298cb07d775f","Type":"ContainerDied","Data":"1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858"}
Jul 24 19:16:24.154106 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:24.154090    2557 scope.go:117] "RemoveContainer" containerID="1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858"
Jul 24 19:16:24.155246 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:24.155215    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:16:24.155365 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:24.155312    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:16:24.155455 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:24.155387    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:16:25.160569 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:25.160531    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" event={"ID":"c3050ddb-c7b4-4959-abaf-298cb07d775f","Type":"ContainerStarted","Data":"af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80"}
Jul 24 19:16:25.420659 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:25.420554    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:25.421043 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:25.420950    2557 patch_prober.go:28] interesting pod/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 19:16:25.421261 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:25.421238    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 19:16:26.420745 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:26.420687    2557 patch_prober.go:28] interesting pod/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 19:16:26.421218 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:26.420777    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 19:16:27.343073 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:27.343035    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:16:27.421323 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:27.420855    2557 patch_prober.go:28] interesting pod/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 19:16:27.421323 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:27.420922    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 19:16:28.420284 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:28.420230    2557 patch_prober.go:28] interesting pod/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 19:16:28.420518 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:28.420301    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 19:16:29.424630 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:29.424600    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:29.425129 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:29.424992    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:29.425903 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:29.425882    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:16:30.187386 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:30.187293    2557 generic.go:356] "Generic (PLEG): container finished" podID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerID="75a770af185e3bdfda3631d65e622f50fb2629f5f3e393dec65207b93e719ff8" exitCode=0
Jul 24 19:16:30.187574 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:30.187366    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" event={"ID":"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23","Type":"ContainerDied","Data":"75a770af185e3bdfda3631d65e622f50fb2629f5f3e393dec65207b93e719ff8"}
Jul 24 19:16:30.187927 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:30.187912    2557 scope.go:117] "RemoveContainer" containerID="75a770af185e3bdfda3631d65e622f50fb2629f5f3e393dec65207b93e719ff8"
Jul 24 19:16:30.188966 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:30.188940    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:16:30.189034 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:30.189019    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:16:30.189081 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:30.189068    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:16:30.692579 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:30.692531    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:31.194729 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:31.194688    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" event={"ID":"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23","Type":"ContainerStarted","Data":"04341d5e3de4eda48422eda3ced06cba1223173016104bb3bfbff9b8ba9fe566"}
Jul 24 19:16:31.387600 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:31.387561    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:31.388804 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:31.388763    2557 patch_prober.go:28] interesting pod/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:16:31.388961 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:31.388847    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 19:16:32.111590 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:32.111552    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:32.387437 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:32.387323    2557 patch_prober.go:28] interesting pod/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:16:32.387437 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:32.387418    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 19:16:33.387363 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:33.387318    2557 patch_prober.go:28] interesting pod/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:16:33.387783 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:33.387402    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 19:16:34.387499 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:34.387465    2557 patch_prober.go:28] interesting pod/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:16:34.387899 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:34.387531    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 19:16:35.387287 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:35.387248    2557 patch_prober.go:28] interesting pod/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:16:35.387512 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:35.387304    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 19:16:36.390512 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:36.390481    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:36.391638 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:36.391618    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:16:36.821199 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:36.821160    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:16:52.381726 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:52.381693    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:57.831478 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:16:57.831438    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:17:05.547723 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:05.547684    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:05.616318 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:05.616286    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:09.369257 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:09.369213    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:10.811445 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:10.811361    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:12.768582 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:12.768547    2557 scope.go:117] "RemoveContainer" containerID="ee7d1813c63f7825b5c894716f28254ec2e0566481a34e7123190a99698bc862"
Jul 24 19:17:21.128578 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:21.128540    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:21.229595 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:21.229563    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:47.075068 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:47.074987    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:48.057805 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:48.057769    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv"]
Jul 24 19:17:48.060234 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:48.060218    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv"
Jul 24 19:17:48.062796 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:48.062774    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:17:48.062940 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:48.062783    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:17:48.068073 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:48.067764    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv"]
Jul 24 19:17:48.121762 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:48.121727    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8016f9e2-9d9c-40e3-89d3-c8040d8c0805-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv\" (UID: \"8016f9e2-9d9c-40e3-89d3-c8040d8c0805\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv"
Jul 24 19:17:48.222753 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:48.222713    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8016f9e2-9d9c-40e3-89d3-c8040d8c0805-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv\" (UID: \"8016f9e2-9d9c-40e3-89d3-c8040d8c0805\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv"
Jul 24 19:17:48.223356 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:48.223331    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8016f9e2-9d9c-40e3-89d3-c8040d8c0805-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv\" (UID: \"8016f9e2-9d9c-40e3-89d3-c8040d8c0805\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv"
Jul 24 19:17:48.336140 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:48.336050    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:48.373587 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:48.373557    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv"
Jul 24 19:17:48.508125 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:48.508100    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv"]
Jul 24 19:17:48.509823 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:17:48.509795    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8016f9e2_9d9c_40e3_89d3_c8040d8c0805.slice/crio-21956fbc6b1cfbd008df2f9afcf9706604fc00826a273b838fefaf99fa311f55 WatchSource:0}: Error finding container 21956fbc6b1cfbd008df2f9afcf9706604fc00826a273b838fefaf99fa311f55: Status 404 returned error can't find the container with id 21956fbc6b1cfbd008df2f9afcf9706604fc00826a273b838fefaf99fa311f55
Jul 24 19:17:48.594868 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:48.594779    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv" event={"ID":"8016f9e2-9d9c-40e3-89d3-c8040d8c0805","Type":"ContainerStarted","Data":"21956fbc6b1cfbd008df2f9afcf9706604fc00826a273b838fefaf99fa311f55"}
Jul 24 19:17:49.601225 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:49.601188    2557 generic.go:356] "Generic (PLEG): container finished" podID="8016f9e2-9d9c-40e3-89d3-c8040d8c0805" containerID="b34c720437b273c1ea014b61a745eb69510c2969b394b736b60d6adfb78f9c86" exitCode=0
Jul 24 19:17:49.601654 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:49.601273    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv" event={"ID":"8016f9e2-9d9c-40e3-89d3-c8040d8c0805","Type":"ContainerDied","Data":"b34c720437b273c1ea014b61a745eb69510c2969b394b736b60d6adfb78f9c86"}
Jul 24 19:17:49.637387 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:49.637348    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:17:50.743983 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:50.743958    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv"
Jul 24 19:17:50.849064 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:50.849024    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8016f9e2-9d9c-40e3-89d3-c8040d8c0805-maas-api-service-ca\") pod \"8016f9e2-9d9c-40e3-89d3-c8040d8c0805\" (UID: \"8016f9e2-9d9c-40e3-89d3-c8040d8c0805\") "
Jul 24 19:17:50.849433 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:50.849408    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8016f9e2-9d9c-40e3-89d3-c8040d8c0805-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8016f9e2-9d9c-40e3-89d3-c8040d8c0805" (UID: "8016f9e2-9d9c-40e3-89d3-c8040d8c0805"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:17:50.949761 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:50.949667    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8016f9e2-9d9c-40e3-89d3-c8040d8c0805-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:17:51.612612 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:51.612581    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv"
Jul 24 19:17:51.612782 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:51.612611    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv" event={"ID":"8016f9e2-9d9c-40e3-89d3-c8040d8c0805","Type":"ContainerDied","Data":"21956fbc6b1cfbd008df2f9afcf9706604fc00826a273b838fefaf99fa311f55"}
Jul 24 19:17:51.612782 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:51.612659    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21956fbc6b1cfbd008df2f9afcf9706604fc00826a273b838fefaf99fa311f55"
Jul 24 19:17:58.539865 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:58.539814    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:58.651586 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:58.651551    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:58.807356 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:58.807245    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:59.126187 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:17:59.126084    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:18:03.134804 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:03.134766    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:03.152273 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:03.152238    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv"]
Jul 24 19:18:03.155340 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:03.155305    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ee838-qssjv"]
Jul 24 19:18:03.535388 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:03.535339    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:04.622011 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:04.621978    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8016f9e2-9d9c-40e3-89d3-c8040d8c0805" path="/var/lib/kubelet/pods/8016f9e2-9d9c-40e3-89d3-c8040d8c0805/volumes"
Jul 24 19:18:07.223992 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:07.223956    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:18:09.492796 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:09.492758    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:09.561573 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:09.561541    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:09.735413 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:09.735361    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"]
Jul 24 19:18:09.735649 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:09.735624    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy" containerID="cri-o://af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80" gracePeriod=30
Jul 24 19:18:09.759978 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:09.759897    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:09.985830 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:09.985800    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:14.427162 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:14.427124    2557 patch_prober.go:28] interesting pod/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:18:14.427600 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:14.427196    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:18:14.995341 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:14.995275    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:18:15.085108 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085056    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3050ddb-c7b4-4959-abaf-298cb07d775f-istiod-ca-cert\") pod \"c3050ddb-c7b4-4959-abaf-298cb07d775f\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") "
Jul 24 19:18:15.085108 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085111    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-token\") pod \"c3050ddb-c7b4-4959-abaf-298cb07d775f\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") "
Jul 24 19:18:15.085433 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085152    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-workload-certs\") pod \"c3050ddb-c7b4-4959-abaf-298cb07d775f\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") "
Jul 24 19:18:15.085433 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085177    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-podinfo\") pod \"c3050ddb-c7b4-4959-abaf-298cb07d775f\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") "
Jul 24 19:18:15.085433 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085256    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-data\") pod \"c3050ddb-c7b4-4959-abaf-298cb07d775f\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") "
Jul 24 19:18:15.085433 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085282    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gscbr\" (UniqueName: \"kubernetes.io/projected/c3050ddb-c7b4-4959-abaf-298cb07d775f-kube-api-access-gscbr\") pod \"c3050ddb-c7b4-4959-abaf-298cb07d775f\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") "
Jul 24 19:18:15.085433 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085333    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-envoy\") pod \"c3050ddb-c7b4-4959-abaf-298cb07d775f\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") "
Jul 24 19:18:15.085433 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085425    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-workload-socket\") pod \"c3050ddb-c7b4-4959-abaf-298cb07d775f\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") "
Jul 24 19:18:15.085748 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085457    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-credential-socket\") pod \"c3050ddb-c7b4-4959-abaf-298cb07d775f\" (UID: \"c3050ddb-c7b4-4959-abaf-298cb07d775f\") "
Jul 24 19:18:15.085748 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085532    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3050ddb-c7b4-4959-abaf-298cb07d775f" (UID: "c3050ddb-c7b4-4959-abaf-298cb07d775f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:15.085748 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085551    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3050ddb-c7b4-4959-abaf-298cb07d775f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3050ddb-c7b4-4959-abaf-298cb07d775f" (UID: "c3050ddb-c7b4-4959-abaf-298cb07d775f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:18:15.085898 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085755    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3050ddb-c7b4-4959-abaf-298cb07d775f" (UID: "c3050ddb-c7b4-4959-abaf-298cb07d775f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:15.085898 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085833    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3050ddb-c7b4-4959-abaf-298cb07d775f-istiod-ca-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:15.085898 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085852    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-workload-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:15.085898 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.085831    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3050ddb-c7b4-4959-abaf-298cb07d775f" (UID: "c3050ddb-c7b4-4959-abaf-298cb07d775f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:15.086244 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.086219    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3050ddb-c7b4-4959-abaf-298cb07d775f" (UID: "c3050ddb-c7b4-4959-abaf-298cb07d775f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:15.087892 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.087868    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3050ddb-c7b4-4959-abaf-298cb07d775f-kube-api-access-gscbr" (OuterVolumeSpecName: "kube-api-access-gscbr") pod "c3050ddb-c7b4-4959-abaf-298cb07d775f" (UID: "c3050ddb-c7b4-4959-abaf-298cb07d775f"). InnerVolumeSpecName "kube-api-access-gscbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:18:15.087976 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.087894    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3050ddb-c7b4-4959-abaf-298cb07d775f" (UID: "c3050ddb-c7b4-4959-abaf-298cb07d775f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:18:15.088042 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.088017    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3050ddb-c7b4-4959-abaf-298cb07d775f" (UID: "c3050ddb-c7b4-4959-abaf-298cb07d775f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:15.088089 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.088035    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3050ddb-c7b4-4959-abaf-298cb07d775f" (UID: "c3050ddb-c7b4-4959-abaf-298cb07d775f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:18:15.186749 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.186709    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-envoy\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:15.186749 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.186741    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-workload-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:15.186749 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.186755    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-credential-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:15.187033 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.186764    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-token\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:15.187033 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.186773    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-podinfo\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:15.187033 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.186781    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3050ddb-c7b4-4959-abaf-298cb07d775f-istio-data\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:15.187033 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.186789    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gscbr\" (UniqueName: \"kubernetes.io/projected/c3050ddb-c7b4-4959-abaf-298cb07d775f-kube-api-access-gscbr\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:15.730504 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.730466    2557 generic.go:356] "Generic (PLEG): container finished" podID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerID="af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80" exitCode=0
Jul 24 19:18:15.731012 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.730521    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"
Jul 24 19:18:15.731012 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.730551    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" event={"ID":"c3050ddb-c7b4-4959-abaf-298cb07d775f","Type":"ContainerDied","Data":"af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80"}
Jul 24 19:18:15.731012 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.730608    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs" event={"ID":"c3050ddb-c7b4-4959-abaf-298cb07d775f","Type":"ContainerDied","Data":"042634253a6d5d8de20ae46783eeb702e85f653ad957de63d2116ca947566390"}
Jul 24 19:18:15.731012 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.730640    2557 scope.go:117] "RemoveContainer" containerID="af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80"
Jul 24 19:18:15.739995 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.739977    2557 scope.go:117] "RemoveContainer" containerID="1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858"
Jul 24 19:18:15.748304 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.748284    2557 scope.go:117] "RemoveContainer" containerID="af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80"
Jul 24 19:18:15.748589 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:18:15.748571    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80\": container with ID starting with af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80 not found: ID does not exist" containerID="af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80"
Jul 24 19:18:15.748637 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.748600    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80"} err="failed to get container status \"af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80\": rpc error: code = NotFound desc = could not find container \"af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80\": container with ID starting with af3f656fc46c751c6ddbd172dfc5981d0ec9e083f87994a1dd98d946eb9b6a80 not found: ID does not exist"
Jul 24 19:18:15.748637 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.748617    2557 scope.go:117] "RemoveContainer" containerID="1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858"
Jul 24 19:18:15.748838 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:18:15.748818    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858\": container with ID starting with 1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858 not found: ID does not exist" containerID="1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858"
Jul 24 19:18:15.748879 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.748846    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858"} err="failed to get container status \"1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858\": rpc error: code = NotFound desc = could not find container \"1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858\": container with ID starting with 1dc78d53805b56ae2832b70f06f3bc99e0a0fc2b673edfb97b835eed8a8c3858 not found: ID does not exist"
Jul 24 19:18:15.752794 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.752767    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"]
Jul 24 19:18:15.760529 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:15.760505    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2ee838-openshift-default-6cdd657584-htpcs"]
Jul 24 19:18:16.624472 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:16.624436    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" path="/var/lib/kubelet/pods/c3050ddb-c7b4-4959-abaf-298cb07d775f/volumes"
Jul 24 19:18:20.683967 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:20.683933    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:20.783409 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:20.783362    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:20.883704 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:20.883668    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:22.921334 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:22.921250    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:18:25.189558 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:25.189524    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:25.564311 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:25.564275    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:31.361437 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:31.361394    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:31.464320 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:31.464287    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:31.598187 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:31.598134    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"]
Jul 24 19:18:31.598480 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:31.598437    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy" containerID="cri-o://04341d5e3de4eda48422eda3ced06cba1223173016104bb3bfbff9b8ba9fe566" gracePeriod=30
Jul 24 19:18:31.621869 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:31.621789    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:31.837134 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:31.837098    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:32.200354 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:32.200322    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:32.541068 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:32.541033    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:32.725443 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:32.725394    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:35.790704 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:35.790664    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:35.883771 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:35.883740    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:36.077543 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.077443    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:36.327045 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.327014    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:36.393440 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.393323    2557 patch_prober.go:28] interesting pod/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:18:36.393440 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.393409    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:18:36.580945 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.580907    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:36.684158 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.684069    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:36.840780 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.840748    2557 generic.go:356] "Generic (PLEG): container finished" podID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerID="04341d5e3de4eda48422eda3ced06cba1223173016104bb3bfbff9b8ba9fe566" exitCode=0
Jul 24 19:18:36.841190 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.840834    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" event={"ID":"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23","Type":"ContainerDied","Data":"04341d5e3de4eda48422eda3ced06cba1223173016104bb3bfbff9b8ba9fe566"}
Jul 24 19:18:36.841190 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.840908    2557 scope.go:117] "RemoveContainer" containerID="75a770af185e3bdfda3631d65e622f50fb2629f5f3e393dec65207b93e719ff8"
Jul 24 19:18:36.871886 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.871863    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:18:36.986508 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.986472    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-podinfo\") pod \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") "
Jul 24 19:18:36.986711 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.986524    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-data\") pod \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") "
Jul 24 19:18:36.986711 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.986552    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istiod-ca-cert\") pod \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") "
Jul 24 19:18:36.986711 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.986577    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-credential-socket\") pod \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") "
Jul 24 19:18:36.986711 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.986593    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-workload-certs\") pod \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") "
Jul 24 19:18:36.986950 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.986754    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-envoy\") pod \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") "
Jul 24 19:18:36.986950 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.986808    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-token\") pod \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") "
Jul 24 19:18:36.986950 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.986836    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-workload-socket\") pod \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") "
Jul 24 19:18:36.986950 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.986883    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf7dm\" (UniqueName: \"kubernetes.io/projected/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-kube-api-access-jf7dm\") pod \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\" (UID: \"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23\") "
Jul 24 19:18:36.986950 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.986908    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" (UID: "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:36.986950 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.986927    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" (UID: "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:36.987266 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.987007    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" (UID: "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:18:36.987266 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.987118    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" (UID: "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:36.987266 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.987192    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-credential-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:36.987266 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.987209    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-workload-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:36.987266 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.987222    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-workload-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:36.987266 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.987231    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istiod-ca-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:36.987606 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.987543    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-data" (OuterVolumeSpecName: "istio-data") pod "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" (UID: "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:36.988982 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.988957    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-token" (OuterVolumeSpecName: "istio-token") pod "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" (UID: "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:18:36.989109 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.989008    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-kube-api-access-jf7dm" (OuterVolumeSpecName: "kube-api-access-jf7dm") pod "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" (UID: "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23"). InnerVolumeSpecName "kube-api-access-jf7dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:18:36.989245 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.989215    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" (UID: "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:36.989360 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:36.989288    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" (UID: "7e043dcb-2259-42b9-a2a1-7bc5b3a00a23"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:18:37.088493 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:37.088454    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-envoy\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:37.088493 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:37.088484    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-token\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:37.088493 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:37.088494    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf7dm\" (UniqueName: \"kubernetes.io/projected/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-kube-api-access-jf7dm\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:37.088493 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:37.088503    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-podinfo\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:37.088776 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:37.088512    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23-istio-data\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:37.848653 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:37.848621    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8" event={"ID":"7e043dcb-2259-42b9-a2a1-7bc5b3a00a23","Type":"ContainerDied","Data":"7c472880f4dbd39eaafb52519bb2890015ee02ab9acd9e2365bbe0894b04e0c7"}
Jul 24 19:18:37.849128 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:37.848675    2557 scope.go:117] "RemoveContainer" containerID="04341d5e3de4eda48422eda3ced06cba1223173016104bb3bfbff9b8ba9fe566"
Jul 24 19:18:37.849128 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:37.848633    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"
Jul 24 19:18:37.874068 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:37.874035    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"]
Jul 24 19:18:37.880633 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:37.880600    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-31c4fa-openshift-default-54db899ccb-l9nt8"]
Jul 24 19:18:38.622651 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:38.622609    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" path="/var/lib/kubelet/pods/7e043dcb-2259-42b9-a2a1-7bc5b3a00a23/volumes"
Jul 24 19:18:40.275043 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:40.275010    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:40.734407 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:40.734355    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:41.012643 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.012558    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"]
Jul 24 19:18:41.013055 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013039    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy"
Jul 24 19:18:41.013143 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013059    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy"
Jul 24 19:18:41.013143 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013072    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy"
Jul 24 19:18:41.013143 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013081    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy"
Jul 24 19:18:41.013143 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013092    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy"
Jul 24 19:18:41.013143 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013100    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy"
Jul 24 19:18:41.013143 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013114    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy"
Jul 24 19:18:41.013143 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013122    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy"
Jul 24 19:18:41.013143 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013138    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8016f9e2-9d9c-40e3-89d3-c8040d8c0805" containerName="revoke-keys"
Jul 24 19:18:41.013143 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013147    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8016f9e2-9d9c-40e3-89d3-c8040d8c0805" containerName="revoke-keys"
Jul 24 19:18:41.013624 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013236    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy"
Jul 24 19:18:41.013624 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013246    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8016f9e2-9d9c-40e3-89d3-c8040d8c0805" containerName="revoke-keys"
Jul 24 19:18:41.013624 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013258    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy"
Jul 24 19:18:41.013624 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013267    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3050ddb-c7b4-4959-abaf-298cb07d775f" containerName="istio-proxy"
Jul 24 19:18:41.013624 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.013276    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e043dcb-2259-42b9-a2a1-7bc5b3a00a23" containerName="istio-proxy"
Jul 24 19:18:41.018617 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.018595    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.021291 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.021268    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a90216-openshift-default-dockercfg-xrx8b\""
Jul 24 19:18:41.026708 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.026519    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"]
Jul 24 19:18:41.043914 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.043872    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:41.122160 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.122122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-podinfo\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.122345 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.122164    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-envoy\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.122345 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.122193    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8q7w\" (UniqueName: \"kubernetes.io/projected/4b816dd8-cc28-4d15-90bd-fb85315c09e4-kube-api-access-h8q7w\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.122345 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.122252    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istiod-ca-cert\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.122345 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.122287    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-data\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.122345 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.122318    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-workload-socket\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.122583 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.122441    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-credential-socket\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.122583 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.122477    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-workload-certs\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.122583 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.122517    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-token\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.143307 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.143271    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:41.223272 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223219    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-credential-socket\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.223272 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223271    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-workload-certs\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.223545 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223303    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-token\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.223545 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223415    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-podinfo\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.223545 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223451    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-envoy\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.223545 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223477    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8q7w\" (UniqueName: \"kubernetes.io/projected/4b816dd8-cc28-4d15-90bd-fb85315c09e4-kube-api-access-h8q7w\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.223545 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223513    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istiod-ca-cert\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.223807 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223555    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-data\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.223807 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223606    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-workload-socket\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.223807 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223717    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-workload-certs\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.223807 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223776    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-credential-socket\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.224011 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223967    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-workload-socket\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.224011 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.223991    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-data\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.224251 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.224228    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istiod-ca-cert\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.225733 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.225711    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-envoy\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.226000 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.225978    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-podinfo\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.230595 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.230573    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8q7w\" (UniqueName: \"kubernetes.io/projected/4b816dd8-cc28-4d15-90bd-fb85315c09e4-kube-api-access-h8q7w\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.231106 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.231087    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-token\") pod \"e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") " pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.330440 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.330338    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:41.470410 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.470384    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"]
Jul 24 19:18:41.472226 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:18:41.472200    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b816dd8_cc28_4d15_90bd_fb85315c09e4.slice/crio-1a01b73adbcc536e674572b6e00ee8371ff92d724fc83ce4a58f9e5369d528c3 WatchSource:0}: Error finding container 1a01b73adbcc536e674572b6e00ee8371ff92d724fc83ce4a58f9e5369d528c3: Status 404 returned error can't find the container with id 1a01b73adbcc536e674572b6e00ee8371ff92d724fc83ce4a58f9e5369d528c3
Jul 24 19:18:41.474142 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.474110    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:18:41.474244 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.474176    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:18:41.474244 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.474206    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:18:41.871507 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.871469    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" event={"ID":"4b816dd8-cc28-4d15-90bd-fb85315c09e4","Type":"ContainerStarted","Data":"7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3"}
Jul 24 19:18:41.871691 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.871521    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" event={"ID":"4b816dd8-cc28-4d15-90bd-fb85315c09e4","Type":"ContainerStarted","Data":"1a01b73adbcc536e674572b6e00ee8371ff92d724fc83ce4a58f9e5369d528c3"}
Jul 24 19:18:41.892646 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:41.892585    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" podStartSLOduration=1.89256757 podStartE2EDuration="1.89256757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:18:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:18:41.891211975 +0000 UTC m=+2309.816164569" watchObservedRunningTime="2026-07-24 19:18:41.89256757 +0000 UTC m=+2309.817520164"
Jul 24 19:18:42.331532 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:42.331494    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:42.336490 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:42.336465    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:42.433733 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:42.433700    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:18:42.877253 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:42.877226    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:42.878181 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:42.878154    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:18:43.804872 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:43.804831    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:43.895050 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:43.895016    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:43.975554 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:43.975506    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:44.075592 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:44.075500    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:44.574423 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:44.574361    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:44.678389 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:44.678351    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:48.290136 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:48.290104    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:56.374397 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:56.374353    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp"]
Jul 24 19:18:56.376752 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:56.376735    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp"
Jul 24 19:18:56.379090 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:56.379067    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:18:56.379090 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:56.379080    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:18:56.385006 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:56.384983    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp"]
Jul 24 19:18:56.466091 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:56.466052    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78867e2c-fc4a-4370-a691-54efeca2a308-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp\" (UID: \"78867e2c-fc4a-4370-a691-54efeca2a308\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp"
Jul 24 19:18:56.567454 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:56.567421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78867e2c-fc4a-4370-a691-54efeca2a308-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp\" (UID: \"78867e2c-fc4a-4370-a691-54efeca2a308\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp"
Jul 24 19:18:56.568049 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:56.568029    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78867e2c-fc4a-4370-a691-54efeca2a308-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp\" (UID: \"78867e2c-fc4a-4370-a691-54efeca2a308\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp"
Jul 24 19:18:56.688267 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:56.688171    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp"
Jul 24 19:18:56.872456 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:56.872387    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp"]
Jul 24 19:18:56.875219 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:18:56.875187    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78867e2c_fc4a_4370_a691_54efeca2a308.slice/crio-48939f01d485b945594c20ec115ff5b903d0889d6ca03ff14cc38d7560cec6b8 WatchSource:0}: Error finding container 48939f01d485b945594c20ec115ff5b903d0889d6ca03ff14cc38d7560cec6b8: Status 404 returned error can't find the container with id 48939f01d485b945594c20ec115ff5b903d0889d6ca03ff14cc38d7560cec6b8
Jul 24 19:18:56.947006 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:56.946923    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp" event={"ID":"78867e2c-fc4a-4370-a691-54efeca2a308","Type":"ContainerStarted","Data":"48939f01d485b945594c20ec115ff5b903d0889d6ca03ff14cc38d7560cec6b8"}
Jul 24 19:18:57.954609 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:57.954515    2557 generic.go:356] "Generic (PLEG): container finished" podID="78867e2c-fc4a-4370-a691-54efeca2a308" containerID="acf25828397bea98035ce237d66323f9da1c65946d72fd579d0b68678b919d99" exitCode=0
Jul 24 19:18:57.955011 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:57.954601    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp" event={"ID":"78867e2c-fc4a-4370-a691-54efeca2a308","Type":"ContainerDied","Data":"acf25828397bea98035ce237d66323f9da1c65946d72fd579d0b68678b919d99"}
Jul 24 19:18:58.919567 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:58.919519    2557 patch_prober.go:28] interesting pod/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 19:18:58.919761 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:58.919600    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 19:18:59.099263 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.099238    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp"
Jul 24 19:18:59.190118 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.190013    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78867e2c-fc4a-4370-a691-54efeca2a308-maas-api-service-ca\") pod \"78867e2c-fc4a-4370-a691-54efeca2a308\" (UID: \"78867e2c-fc4a-4370-a691-54efeca2a308\") "
Jul 24 19:18:59.190348 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.190321    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78867e2c-fc4a-4370-a691-54efeca2a308-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "78867e2c-fc4a-4370-a691-54efeca2a308" (UID: "78867e2c-fc4a-4370-a691-54efeca2a308"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:18:59.291566 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.291510    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78867e2c-fc4a-4370-a691-54efeca2a308-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:18:59.829211 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.829171    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:18:59.965341 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.965312    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp"
Jul 24 19:18:59.965554 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.965316    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp" event={"ID":"78867e2c-fc4a-4370-a691-54efeca2a308","Type":"ContainerDied","Data":"48939f01d485b945594c20ec115ff5b903d0889d6ca03ff14cc38d7560cec6b8"}
Jul 24 19:18:59.965554 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.965423    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48939f01d485b945594c20ec115ff5b903d0889d6ca03ff14cc38d7560cec6b8"
Jul 24 19:18:59.967022 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.966997    2557 generic.go:356] "Generic (PLEG): container finished" podID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerID="7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3" exitCode=0
Jul 24 19:18:59.967152 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.967028    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" event={"ID":"4b816dd8-cc28-4d15-90bd-fb85315c09e4","Type":"ContainerDied","Data":"7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3"}
Jul 24 19:18:59.967455 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.967438    2557 scope.go:117] "RemoveContainer" containerID="7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3"
Jul 24 19:18:59.968566 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.968536    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:18:59.968638 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.968622    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:18:59.968680 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:18:59.968662    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:19:00.974156 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:00.974119    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" event={"ID":"4b816dd8-cc28-4d15-90bd-fb85315c09e4","Type":"ContainerStarted","Data":"5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5"}
Jul 24 19:19:01.331448 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:01.331334    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:19:01.331604 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:01.331547    2557 patch_prober.go:28] interesting pod/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 24 19:19:01.331648 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:01.331600    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 24 19:19:02.331326 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:02.331286    2557 patch_prober.go:28] interesting pod/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 24 19:19:02.331785 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:02.331356    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 24 19:19:03.331577 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:03.331536    2557 patch_prober.go:28] interesting pod/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 24 19:19:03.331994 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:03.331595    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 24 19:19:04.331289 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:04.331249    2557 patch_prober.go:28] interesting pod/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 24 19:19:04.331498 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:04.331309    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 24 19:19:05.334629 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:05.334589    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:19:05.335021 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:05.334921    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:19:05.335726 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:05.335701    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:19:11.544670 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:11.544639    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:11.645067 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:11.645035    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:11.746127 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:11.746078    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:12.796083 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:12.796049    2557 scope.go:117] "RemoveContainer" containerID="e05b7233d6dfd2dfa262e1838ea91ef570c0dcf9d54998ac997b76c9a276e6fe"
Jul 24 19:19:15.027003 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:15.026962    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:19:16.453457 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:16.453419    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:16.454394 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:16.454356    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp"]
Jul 24 19:19:16.456649 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:16.456627    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e9947-g8mxp"]
Jul 24 19:19:16.622160 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:16.622126    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78867e2c-fc4a-4370-a691-54efeca2a308" path="/var/lib/kubelet/pods/78867e2c-fc4a-4370-a691-54efeca2a308/volumes"
Jul 24 19:19:16.967640 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:16.967595    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:22.927061 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:22.926980    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:22.989290 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:22.989253    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:23.213439 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.213404    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:23.451164 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.451129    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:23.571401 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.571296    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72"]
Jul 24 19:19:23.571781 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.571762    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78867e2c-fc4a-4370-a691-54efeca2a308" containerName="revoke-keys"
Jul 24 19:19:23.571877 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.571784    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="78867e2c-fc4a-4370-a691-54efeca2a308" containerName="revoke-keys"
Jul 24 19:19:23.571931 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.571901    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="78867e2c-fc4a-4370-a691-54efeca2a308" containerName="revoke-keys"
Jul 24 19:19:23.573827 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.573808    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72"
Jul 24 19:19:23.576159 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.576137    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:19:23.576276 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.576163    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:19:23.581947 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.581918    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72"]
Jul 24 19:19:23.599473 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.599438    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b94f6ba-b8b3-4a9e-b902-068d08a735e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a90216-7kc72\" (UID: \"8b94f6ba-b8b3-4a9e-b902-068d08a735e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72"
Jul 24 19:19:23.700717 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.700677    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b94f6ba-b8b3-4a9e-b902-068d08a735e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a90216-7kc72\" (UID: \"8b94f6ba-b8b3-4a9e-b902-068d08a735e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72"
Jul 24 19:19:23.701330 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.701300    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b94f6ba-b8b3-4a9e-b902-068d08a735e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a90216-7kc72\" (UID: \"8b94f6ba-b8b3-4a9e-b902-068d08a735e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72"
Jul 24 19:19:23.885546 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:23.885444    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72"
Jul 24 19:19:24.022986 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:24.022962    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72"]
Jul 24 19:19:24.025517 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:19:24.025487    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b94f6ba_b8b3_4a9e_b902_068d08a735e6.slice/crio-dbbfe3756acc162bd285c7f06c600b09acdd56bd06908589847ce3cb13ff40ab WatchSource:0}: Error finding container dbbfe3756acc162bd285c7f06c600b09acdd56bd06908589847ce3cb13ff40ab: Status 404 returned error can't find the container with id dbbfe3756acc162bd285c7f06c600b09acdd56bd06908589847ce3cb13ff40ab
Jul 24 19:19:24.092789 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:24.092756    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72" event={"ID":"8b94f6ba-b8b3-4a9e-b902-068d08a735e6","Type":"ContainerStarted","Data":"dbbfe3756acc162bd285c7f06c600b09acdd56bd06908589847ce3cb13ff40ab"}
Jul 24 19:19:25.099049 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:25.099014    2557 generic.go:356] "Generic (PLEG): container finished" podID="8b94f6ba-b8b3-4a9e-b902-068d08a735e6" containerID="908e6f8fc3856c477aac7c8c99536ab57d7c2d33139e060649f9cef725458ee5" exitCode=0
Jul 24 19:19:25.099475 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:25.099111    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72" event={"ID":"8b94f6ba-b8b3-4a9e-b902-068d08a735e6","Type":"ContainerDied","Data":"908e6f8fc3856c477aac7c8c99536ab57d7c2d33139e060649f9cef725458ee5"}
Jul 24 19:19:26.265838 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:26.265812    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72"
Jul 24 19:19:26.322490 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:26.322451    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b94f6ba-b8b3-4a9e-b902-068d08a735e6-maas-api-service-ca\") pod \"8b94f6ba-b8b3-4a9e-b902-068d08a735e6\" (UID: \"8b94f6ba-b8b3-4a9e-b902-068d08a735e6\") "
Jul 24 19:19:26.322800 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:26.322776    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b94f6ba-b8b3-4a9e-b902-068d08a735e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b94f6ba-b8b3-4a9e-b902-068d08a735e6" (UID: "8b94f6ba-b8b3-4a9e-b902-068d08a735e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:19:26.423161 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:26.423067    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b94f6ba-b8b3-4a9e-b902-068d08a735e6-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:19:27.110362 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:27.110331    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72"
Jul 24 19:19:27.110562 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:27.110329    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72" event={"ID":"8b94f6ba-b8b3-4a9e-b902-068d08a735e6","Type":"ContainerDied","Data":"dbbfe3756acc162bd285c7f06c600b09acdd56bd06908589847ce3cb13ff40ab"}
Jul 24 19:19:27.110562 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:27.110457    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbbfe3756acc162bd285c7f06c600b09acdd56bd06908589847ce3cb13ff40ab"
Jul 24 19:19:39.031588 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:39.031545    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:39.097526 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:39.097490    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:39.156943 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:39.156906    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:43.645042 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:43.645004    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:43.649785 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:43.649755    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72"]
Jul 24 19:19:43.651964 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:43.651940    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a90216-7kc72"]
Jul 24 19:19:43.824001 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:43.823969    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:19:44.049567 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:44.049537    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:44.621772 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:44.621735    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b94f6ba-b8b3-4a9e-b902-068d08a735e6" path="/var/lib/kubelet/pods/8b94f6ba-b8b3-4a9e-b902-068d08a735e6/volumes"
Jul 24 19:19:45.469953 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:45.469918    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:49.901818 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:49.901779    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:49.966439 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:49.966410    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:50.363615 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:50.363584    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"]
Jul 24 19:19:50.363853 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:50.363823    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerName="istio-proxy" containerID="cri-o://5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5" gracePeriod=30
Jul 24 19:19:50.389362 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:50.389336    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:50.642551 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:50.642469    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:51.073859 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.073828    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:51.568891 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.568858    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"]
Jul 24 19:19:51.569247 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.569234    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b94f6ba-b8b3-4a9e-b902-068d08a735e6" containerName="revoke-keys"
Jul 24 19:19:51.569293 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.569249    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b94f6ba-b8b3-4a9e-b902-068d08a735e6" containerName="revoke-keys"
Jul 24 19:19:51.569330 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.569319    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b94f6ba-b8b3-4a9e-b902-068d08a735e6" containerName="revoke-keys"
Jul 24 19:19:51.571226 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.571203    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.573684 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.573662    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-65184f-openshift-default-dockercfg-hd85v\""
Jul 24 19:19:51.584580 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.584553    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"]
Jul 24 19:19:51.595996 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.595961    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:51.647685 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.647652    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-credential-socket\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.647849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.647692    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istiod-ca-cert\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.647849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.647718    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-data\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.647849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.647761    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tksw\" (UniqueName: \"kubernetes.io/projected/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-kube-api-access-7tksw\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.647849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.647795    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-podinfo\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.647849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.647816    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-workload-socket\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.647849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.647830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-token\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.647849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.647850    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-workload-certs\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.648092 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.647918    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-envoy\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.697141 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.697106    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:51.748785 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.748744    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tksw\" (UniqueName: \"kubernetes.io/projected/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-kube-api-access-7tksw\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.748936 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.748812    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-podinfo\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.748936 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.748842    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-workload-socket\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.748936 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.748861    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-token\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.748936 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.748879    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-workload-certs\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.748936 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.748907    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-envoy\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.749151 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.748963    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-credential-socket\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.749151 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.748996    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istiod-ca-cert\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.749151 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.749024    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-data\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.749342 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.749318    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-workload-socket\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.749438 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.749401    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-workload-certs\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.749506 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.749451    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-data\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.749590 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.749565    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-credential-socket\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.749906 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.749885    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istiod-ca-cert\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.751420 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.751395    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-envoy\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.751545 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.751445    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-podinfo\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.758696 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.758662    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-token\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.759229 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.759203    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tksw\" (UniqueName: \"kubernetes.io/projected/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-kube-api-access-7tksw\") pod \"e2e-shared-a-65184f-openshift-default-546fc96b76-fng27\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") " pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:51.881807 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:51.881708    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:52.027019 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:52.026992    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"]
Jul 24 19:19:52.028911 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:19:52.028879    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf72f3c2_ce27_4eb9_84d7_47e0f6fe286f.slice/crio-8d90cebf7e8605f1e30e021fc09fac5b4deab54b9e1c4f2885c50c228c119f79 WatchSource:0}: Error finding container 8d90cebf7e8605f1e30e021fc09fac5b4deab54b9e1c4f2885c50c228c119f79: Status 404 returned error can't find the container with id 8d90cebf7e8605f1e30e021fc09fac5b4deab54b9e1c4f2885c50c228c119f79
Jul 24 19:19:52.031124 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:52.031091    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:19:52.031223 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:52.031157    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:19:52.031223 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:52.031184    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:19:52.235386 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:52.235341    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" event={"ID":"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f","Type":"ContainerStarted","Data":"0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757"}
Jul 24 19:19:52.235849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:52.235426    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" event={"ID":"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f","Type":"ContainerStarted","Data":"8d90cebf7e8605f1e30e021fc09fac5b4deab54b9e1c4f2885c50c228c119f79"}
Jul 24 19:19:52.257913 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:52.257852    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" podStartSLOduration=1.2578322929999999 podStartE2EDuration="1.257832293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:19:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:19:52.256710153 +0000 UTC m=+2380.181662762" watchObservedRunningTime="2026-07-24 19:19:52.257832293 +0000 UTC m=+2380.182784888"
Jul 24 19:19:52.882241 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:52.882203    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:53.887006 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:53.886979    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:54.245160 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:54.245130    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:54.246059 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:54.246038    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:19:54.330344 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:54.330307    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:54.412569 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:54.412524    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:54.477000 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:54.476969    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:54.606797 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:54.606682    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:55.014779 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.014745    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:55.114684 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.114644    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:55.615365 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.615337    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:19:55.786209 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786171    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8q7w\" (UniqueName: \"kubernetes.io/projected/4b816dd8-cc28-4d15-90bd-fb85315c09e4-kube-api-access-h8q7w\") pod \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") "
Jul 24 19:19:55.786447 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786213    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-token\") pod \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") "
Jul 24 19:19:55.786447 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786250    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-envoy\") pod \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") "
Jul 24 19:19:55.786447 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786284    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-data\") pod \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") "
Jul 24 19:19:55.786447 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786308    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-workload-certs\") pod \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") "
Jul 24 19:19:55.786447 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786336    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-credential-socket\") pod \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") "
Jul 24 19:19:55.786447 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786416    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-workload-socket\") pod \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") "
Jul 24 19:19:55.786812 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786502    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-podinfo\") pod \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") "
Jul 24 19:19:55.786812 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786558    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istiod-ca-cert\") pod \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\" (UID: \"4b816dd8-cc28-4d15-90bd-fb85315c09e4\") "
Jul 24 19:19:55.786812 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786658    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4b816dd8-cc28-4d15-90bd-fb85315c09e4" (UID: "4b816dd8-cc28-4d15-90bd-fb85315c09e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:19:55.786812 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786707    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4b816dd8-cc28-4d15-90bd-fb85315c09e4" (UID: "4b816dd8-cc28-4d15-90bd-fb85315c09e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:19:55.787020 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786840    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4b816dd8-cc28-4d15-90bd-fb85315c09e4" (UID: "4b816dd8-cc28-4d15-90bd-fb85315c09e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:19:55.787020 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786936    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-workload-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:19:55.787020 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786959    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-credential-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:19:55.787020 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.786976    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-workload-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:19:55.787020 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.787003    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4b816dd8-cc28-4d15-90bd-fb85315c09e4" (UID: "4b816dd8-cc28-4d15-90bd-fb85315c09e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:19:55.787490 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.787468    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "4b816dd8-cc28-4d15-90bd-fb85315c09e4" (UID: "4b816dd8-cc28-4d15-90bd-fb85315c09e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:19:55.788660 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.788637    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b816dd8-cc28-4d15-90bd-fb85315c09e4" (UID: "4b816dd8-cc28-4d15-90bd-fb85315c09e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:19:55.788770 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.788724    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b816dd8-cc28-4d15-90bd-fb85315c09e4-kube-api-access-h8q7w" (OuterVolumeSpecName: "kube-api-access-h8q7w") pod "4b816dd8-cc28-4d15-90bd-fb85315c09e4" (UID: "4b816dd8-cc28-4d15-90bd-fb85315c09e4"). InnerVolumeSpecName "kube-api-access-h8q7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:19:55.788905 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.788888    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4b816dd8-cc28-4d15-90bd-fb85315c09e4" (UID: "4b816dd8-cc28-4d15-90bd-fb85315c09e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:19:55.788963 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.788944    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4b816dd8-cc28-4d15-90bd-fb85315c09e4" (UID: "4b816dd8-cc28-4d15-90bd-fb85315c09e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:19:55.888307 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.888265    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-podinfo\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:19:55.888307 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.888298    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istiod-ca-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:19:55.888307 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.888312    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8q7w\" (UniqueName: \"kubernetes.io/projected/4b816dd8-cc28-4d15-90bd-fb85315c09e4-kube-api-access-h8q7w\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:19:55.888594 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.888326    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-token\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:19:55.888594 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.888339    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-envoy\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:19:55.888594 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:55.888350    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b816dd8-cc28-4d15-90bd-fb85315c09e4-istio-data\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:19:56.263498 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.263462    2557 generic.go:356] "Generic (PLEG): container finished" podID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerID="5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5" exitCode=0
Jul 24 19:19:56.263994 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.263520    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"
Jul 24 19:19:56.263994 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.263549    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" event={"ID":"4b816dd8-cc28-4d15-90bd-fb85315c09e4","Type":"ContainerDied","Data":"5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5"}
Jul 24 19:19:56.263994 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.263655    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz" event={"ID":"4b816dd8-cc28-4d15-90bd-fb85315c09e4","Type":"ContainerDied","Data":"1a01b73adbcc536e674572b6e00ee8371ff92d724fc83ce4a58f9e5369d528c3"}
Jul 24 19:19:56.263994 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.263700    2557 scope.go:117] "RemoveContainer" containerID="5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5"
Jul 24 19:19:56.273919 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.273895    2557 scope.go:117] "RemoveContainer" containerID="7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3"
Jul 24 19:19:56.284267 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.284241    2557 scope.go:117] "RemoveContainer" containerID="5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5"
Jul 24 19:19:56.285872 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:19:56.285836    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5\": container with ID starting with 5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5 not found: ID does not exist" containerID="5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5"
Jul 24 19:19:56.286006 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.285882    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5"} err="failed to get container status \"5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5\": rpc error: code = NotFound desc = could not find container \"5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5\": container with ID starting with 5240b6d108e5a34818af14744f5195387713e35f954d3e801f3c7d5d3c6fdea5 not found: ID does not exist"
Jul 24 19:19:56.286006 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.285907    2557 scope.go:117] "RemoveContainer" containerID="7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3"
Jul 24 19:19:56.286218 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:19:56.286199    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3\": container with ID starting with 7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3 not found: ID does not exist" containerID="7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3"
Jul 24 19:19:56.286263 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.286225    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3"} err="failed to get container status \"7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3\": rpc error: code = NotFound desc = could not find container \"7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3\": container with ID starting with 7b96947ec0a6ecf6640761f3080ed4a9b047782a19264ae96cea9838d2b990f3 not found: ID does not exist"
Jul 24 19:19:56.287451 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.287431    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"]
Jul 24 19:19:56.294672 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.294647    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a90216-openshift-default-5fc5c78f44-fq8cz"]
Jul 24 19:19:56.622283 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:56.622199    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" path="/var/lib/kubelet/pods/4b816dd8-cc28-4d15-90bd-fb85315c09e4/volumes"
Jul 24 19:19:58.996223 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:58.996188    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:59.315174 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:59.315073    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:59.637634 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:59.637540    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:59.724055 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:19:59.724014    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:00.428917 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:00.428880    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:20:02.256298 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:02.256206    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:02.403410 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:02.402893    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:02.505065 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:02.505010    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:02.940050 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:02.939977    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:03.039265 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:03.039227    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:03.301518 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:03.301483    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:06.717038 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:06.716996    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:09.246998 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:09.246961    2557 patch_prober.go:28] interesting pod/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 24 19:20:09.247455 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:09.247017    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" podUID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 24 19:20:09.346016 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:09.345980    2557 generic.go:356] "Generic (PLEG): container finished" podID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerID="0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757" exitCode=0
Jul 24 19:20:09.346218 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:09.346059    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" event={"ID":"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f","Type":"ContainerDied","Data":"0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757"}
Jul 24 19:20:09.346529 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:09.346512    2557 scope.go:117] "RemoveContainer" containerID="0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757"
Jul 24 19:20:09.347631 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:09.347606    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:20:09.347699 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:09.347679    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:20:09.347737 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:09.347714    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:20:10.353427 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:10.353393    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" event={"ID":"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f","Type":"ContainerStarted","Data":"44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e"}
Jul 24 19:20:10.882196 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:10.882161    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:20:10.882429 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:10.882408    2557 patch_prober.go:28] interesting pod/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 24 19:20:10.882502 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:10.882484    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" podUID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 24 19:20:11.882289 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:11.882252    2557 patch_prober.go:28] interesting pod/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 24 19:20:11.882744 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:11.882310    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" podUID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 24 19:20:12.823935 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:12.823890    2557 scope.go:117] "RemoveContainer" containerID="3a75f80aa45e69b0521122d6487eb51c7ff3775172a7535617efd4338117b27d"
Jul 24 19:20:12.882685 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:12.882643    2557 patch_prober.go:28] interesting pod/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 24 19:20:12.883184 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:12.882729    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" podUID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 24 19:20:13.882590 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:13.882552    2557 patch_prober.go:28] interesting pod/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 24 19:20:13.882775 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:13.882604    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" podUID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 24 19:20:14.219016 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:14.218977    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:20:14.886273 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:14.886242    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:20:14.886803 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:14.886678    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:20:14.887443 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:14.887424    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:20:19.853460 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.853422    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"]
Jul 24 19:20:19.853958 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.853786    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerName="istio-proxy"
Jul 24 19:20:19.853958 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.853798    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerName="istio-proxy"
Jul 24 19:20:19.853958 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.853808    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerName="istio-proxy"
Jul 24 19:20:19.853958 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.853813    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerName="istio-proxy"
Jul 24 19:20:19.853958 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.853871    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerName="istio-proxy"
Jul 24 19:20:19.853958 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.853878    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b816dd8-cc28-4d15-90bd-fb85315c09e4" containerName="istio-proxy"
Jul 24 19:20:19.855856 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.855832    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:19.859679 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.859648    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-65184f\"/\"openshift-service-ca.crt\""
Jul 24 19:20:19.859679 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.859651    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-65184f\"/\"auth-test-model-65184f-kserve-self-signed-certs\""
Jul 24 19:20:19.859862 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.859741    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-65184f\"/\"default-dockercfg-sbqkj\""
Jul 24 19:20:19.860028 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.860002    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-65184f\"/\"kube-root-ca.crt\""
Jul 24 19:20:19.865280 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.865254    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"]
Jul 24 19:20:19.892001 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.891963    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:19.908225 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.908182    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-model-cache\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:19.908225 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.908217    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-tmp-dir\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:19.908490 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.908253    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72dd4a7b-1c97-4dec-a1d4-742a6820d839-tls-certs\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:19.908490 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.908317    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lbsr\" (UniqueName: \"kubernetes.io/projected/72dd4a7b-1c97-4dec-a1d4-742a6820d839-kube-api-access-2lbsr\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:19.908490 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.908355    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-home\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:19.908490 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:19.908370    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-dshm\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.009771 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.009735    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-model-cache\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.009771 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.009769    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-tmp-dir\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.010043 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.009795    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72dd4a7b-1c97-4dec-a1d4-742a6820d839-tls-certs\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.010043 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.009825    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lbsr\" (UniqueName: \"kubernetes.io/projected/72dd4a7b-1c97-4dec-a1d4-742a6820d839-kube-api-access-2lbsr\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.010043 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.009855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-home\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.010043 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.009869    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-dshm\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.010266 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.010184    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-tmp-dir\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.010327 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.010285    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-model-cache\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.010367 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.010319    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-home\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.012250 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.012230    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-dshm\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.012410 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.012390    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72dd4a7b-1c97-4dec-a1d4-742a6820d839-tls-certs\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.019160 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.019134    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lbsr\" (UniqueName: \"kubernetes.io/projected/72dd4a7b-1c97-4dec-a1d4-742a6820d839-kube-api-access-2lbsr\") pod \"auth-test-model-65184f-kserve-5bf74d97f5-2tx9n\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") " pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.167322 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.167222    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:20.311092 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.311055    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"]
Jul 24 19:20:20.311237 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:20:20.311135    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72dd4a7b_1c97_4dec_a1d4_742a6820d839.slice/crio-2e926135334c44e7e4294d981fb5972dd352b90313018ccdb9faf84596e0d374 WatchSource:0}: Error finding container 2e926135334c44e7e4294d981fb5972dd352b90313018ccdb9faf84596e0d374: Status 404 returned error can't find the container with id 2e926135334c44e7e4294d981fb5972dd352b90313018ccdb9faf84596e0d374
Jul 24 19:20:20.404769 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.404734    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n" event={"ID":"72dd4a7b-1c97-4dec-a1d4-742a6820d839","Type":"ContainerStarted","Data":"aacfe7e986081de55e1aeee64da1e910f5b33712042046586b929025e37f5106"}
Jul 24 19:20:20.404936 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.404779    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n" event={"ID":"72dd4a7b-1c97-4dec-a1d4-742a6820d839","Type":"ContainerStarted","Data":"2e926135334c44e7e4294d981fb5972dd352b90313018ccdb9faf84596e0d374"}
Jul 24 19:20:20.423266 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:20.423152    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n" podStartSLOduration=1.423131708 podStartE2EDuration="1.423131708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:20:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:20:20.421102624 +0000 UTC m=+2408.346055239" watchObservedRunningTime="2026-07-24 19:20:20.423131708 +0000 UTC m=+2408.348084280"
Jul 24 19:20:24.428733 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:24.428694    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:20:30.168311 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:30.168270    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:30.168813 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:30.168563    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:30.181096 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:30.181067    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:30.465870 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:30.465840    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:20:45.701729 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:45.701646    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:49.326901 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:20:49.326861    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:21:13.327245 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:21:13.327207    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:21:31.232949 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:21:31.232901    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:21:50.245708 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:21:50.245669    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:22:04.437079 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:22:04.436993    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:22:05.055924 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:22:05.055886    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:23.026344 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:22:23.026305    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:22:25.097237 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:22:25.097202    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:38.732303 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:22:38.732267    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:22:56.532590 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:22:56.532551    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:22:57.009599 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:22:57.009553    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:23:01.135916 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:01.135877    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"]
Jul 24 19:23:01.152707 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:01.152678    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:23:02.170040 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:02.170004    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:23:13.235315 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:13.235277    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:23:16.155506 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.155466    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n" podUID="72dd4a7b-1c97-4dec-a1d4-742a6820d839" containerName="main" containerID="cri-o://aacfe7e986081de55e1aeee64da1e910f5b33712042046586b929025e37f5106" gracePeriod=45
Jul 24 19:23:16.283738 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.283706    2557 generic.go:356] "Generic (PLEG): container finished" podID="72dd4a7b-1c97-4dec-a1d4-742a6820d839" containerID="aacfe7e986081de55e1aeee64da1e910f5b33712042046586b929025e37f5106" exitCode=0
Jul 24 19:23:16.283905 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.283772    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n" event={"ID":"72dd4a7b-1c97-4dec-a1d4-742a6820d839","Type":"ContainerDied","Data":"aacfe7e986081de55e1aeee64da1e910f5b33712042046586b929025e37f5106"}
Jul 24 19:23:16.407781 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.407713    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:23:16.537545 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.537513    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-home\") pod \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") "
Jul 24 19:23:16.537704 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.537554    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-model-cache\") pod \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") "
Jul 24 19:23:16.537704 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.537590    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-tmp-dir\") pod \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") "
Jul 24 19:23:16.537704 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.537615    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lbsr\" (UniqueName: \"kubernetes.io/projected/72dd4a7b-1c97-4dec-a1d4-742a6820d839-kube-api-access-2lbsr\") pod \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") "
Jul 24 19:23:16.537704 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.537681    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-dshm\") pod \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") "
Jul 24 19:23:16.537924 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.537737    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72dd4a7b-1c97-4dec-a1d4-742a6820d839-tls-certs\") pod \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\" (UID: \"72dd4a7b-1c97-4dec-a1d4-742a6820d839\") "
Jul 24 19:23:16.537924 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.537828    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-home" (OuterVolumeSpecName: "home") pod "72dd4a7b-1c97-4dec-a1d4-742a6820d839" (UID: "72dd4a7b-1c97-4dec-a1d4-742a6820d839"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:23:16.537924 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.537870    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "72dd4a7b-1c97-4dec-a1d4-742a6820d839" (UID: "72dd4a7b-1c97-4dec-a1d4-742a6820d839"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:23:16.537924 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.537878    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-model-cache" (OuterVolumeSpecName: "model-cache") pod "72dd4a7b-1c97-4dec-a1d4-742a6820d839" (UID: "72dd4a7b-1c97-4dec-a1d4-742a6820d839"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:23:16.538129 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.538118    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-home\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:23:16.538169 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.538132    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-model-cache\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:23:16.538169 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.538142    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-tmp-dir\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:23:16.539943 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.539906    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72dd4a7b-1c97-4dec-a1d4-742a6820d839-kube-api-access-2lbsr" (OuterVolumeSpecName: "kube-api-access-2lbsr") pod "72dd4a7b-1c97-4dec-a1d4-742a6820d839" (UID: "72dd4a7b-1c97-4dec-a1d4-742a6820d839"). InnerVolumeSpecName "kube-api-access-2lbsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:23:16.540244 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.540222    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72dd4a7b-1c97-4dec-a1d4-742a6820d839-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "72dd4a7b-1c97-4dec-a1d4-742a6820d839" (UID: "72dd4a7b-1c97-4dec-a1d4-742a6820d839"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:23:16.540348 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.540247    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-dshm" (OuterVolumeSpecName: "dshm") pod "72dd4a7b-1c97-4dec-a1d4-742a6820d839" (UID: "72dd4a7b-1c97-4dec-a1d4-742a6820d839"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:23:16.639419 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.639369    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72dd4a7b-1c97-4dec-a1d4-742a6820d839-dshm\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:23:16.639542 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.639435    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72dd4a7b-1c97-4dec-a1d4-742a6820d839-tls-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:23:16.639542 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:16.639445    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lbsr\" (UniqueName: \"kubernetes.io/projected/72dd4a7b-1c97-4dec-a1d4-742a6820d839-kube-api-access-2lbsr\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:23:17.162456 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.162414    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"]
Jul 24 19:23:17.162841 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.162826    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72dd4a7b-1c97-4dec-a1d4-742a6820d839" containerName="main"
Jul 24 19:23:17.162891 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.162844    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="72dd4a7b-1c97-4dec-a1d4-742a6820d839" containerName="main"
Jul 24 19:23:17.162928 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.162912    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="72dd4a7b-1c97-4dec-a1d4-742a6820d839" containerName="main"
Jul 24 19:23:17.166131 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.166107    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.168911 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.168884    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-65184f\"/\"sub-test-model-65184f-kserve-self-signed-certs\""
Jul 24 19:23:17.178899 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.178873    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"]
Jul 24 19:23:17.190593 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.190564    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:23:17.245204 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.245173    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-home\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.245410 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.245218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94ecf556-a2a3-484d-a975-144e65b04bb9-tls-certs\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.245410 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.245248    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-model-cache\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.245410 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.245270    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-tmp-dir\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.245410 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.245354    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt684\" (UniqueName: \"kubernetes.io/projected/94ecf556-a2a3-484d-a975-144e65b04bb9-kube-api-access-xt684\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.245556 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.245412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-dshm\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.290176 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.290145    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n" event={"ID":"72dd4a7b-1c97-4dec-a1d4-742a6820d839","Type":"ContainerDied","Data":"2e926135334c44e7e4294d981fb5972dd352b90313018ccdb9faf84596e0d374"}
Jul 24 19:23:17.290351 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.290194    2557 scope.go:117] "RemoveContainer" containerID="aacfe7e986081de55e1aeee64da1e910f5b33712042046586b929025e37f5106"
Jul 24 19:23:17.290351 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.290194    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"
Jul 24 19:23:17.309326 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.309296    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"]
Jul 24 19:23:17.311874 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.311850    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/auth-test-model-65184f-kserve-5bf74d97f5-2tx9n"]
Jul 24 19:23:17.346520 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.346483    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94ecf556-a2a3-484d-a975-144e65b04bb9-tls-certs\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.346697 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.346529    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-model-cache\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.346697 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.346557    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-tmp-dir\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.346697 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.346613    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt684\" (UniqueName: \"kubernetes.io/projected/94ecf556-a2a3-484d-a975-144e65b04bb9-kube-api-access-xt684\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.346697 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.346645    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-dshm\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.346889 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.346720    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-home\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.347054 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.347029    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-tmp-dir\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.347054 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.347045    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-model-cache\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.347174 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.347072    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-home\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.348934 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.348906    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-dshm\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.349086 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.349070    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94ecf556-a2a3-484d-a975-144e65b04bb9-tls-certs\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.355822 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.355791    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt684\" (UniqueName: \"kubernetes.io/projected/94ecf556-a2a3-484d-a975-144e65b04bb9-kube-api-access-xt684\") pod \"sub-test-model-65184f-kserve-6887756c5-gb2w5\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") " pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.475833 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.475799    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:17.612412 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:17.612360    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"]
Jul 24 19:23:17.614950 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:23:17.614920    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94ecf556_a2a3_484d_a975_144e65b04bb9.slice/crio-78f1fde894014a64e4f4703b7cc62ed45ec208a2b4c32a1565d6b8ef049a8e54 WatchSource:0}: Error finding container 78f1fde894014a64e4f4703b7cc62ed45ec208a2b4c32a1565d6b8ef049a8e54: Status 404 returned error can't find the container with id 78f1fde894014a64e4f4703b7cc62ed45ec208a2b4c32a1565d6b8ef049a8e54
Jul 24 19:23:18.298750 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:18.298711    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5" event={"ID":"94ecf556-a2a3-484d-a975-144e65b04bb9","Type":"ContainerStarted","Data":"7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16"}
Jul 24 19:23:18.299190 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:18.298762    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5" event={"ID":"94ecf556-a2a3-484d-a975-144e65b04bb9","Type":"ContainerStarted","Data":"78f1fde894014a64e4f4703b7cc62ed45ec208a2b4c32a1565d6b8ef049a8e54"}
Jul 24 19:23:18.316536 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:18.316487    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5" podStartSLOduration=1.316471853 podStartE2EDuration="1.316471853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:23:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:23:18.315066946 +0000 UTC m=+2586.240019562" watchObservedRunningTime="2026-07-24 19:23:18.316471853 +0000 UTC m=+2586.241424447"
Jul 24 19:23:18.621519 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:18.621433    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72dd4a7b-1c97-4dec-a1d4-742a6820d839" path="/var/lib/kubelet/pods/72dd4a7b-1c97-4dec-a1d4-742a6820d839/volumes"
Jul 24 19:23:19.393032 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:19.392998    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:23:20.228971 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:20.228932    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:23:27.476583 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:27.476544    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:27.477044 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:27.476601    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:27.489173 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:27.489137    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:28.359957 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:28.359924    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:23:39.993156 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:39.993072    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:23:43.721835 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:23:43.721795    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:24:02.850630 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:02.850591    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:24:08.530225 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:08.530189    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:24:12.871597 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:12.871563    2557 scope.go:117] "RemoveContainer" containerID="b34c720437b273c1ea014b61a745eb69510c2969b394b736b60d6adfb78f9c86"
Jul 24 19:24:25.661181 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:25.661144    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"]
Jul 24 19:24:25.681429 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:25.681394    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:24:26.467119 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:26.467083    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:24:31.222961 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:31.222929    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:24:32.941572 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:32.941541    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:24:40.680406 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:40.680348    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5" podUID="94ecf556-a2a3-484d-a975-144e65b04bb9" containerName="main" containerID="cri-o://7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16" gracePeriod=45
Jul 24 19:24:40.829712 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:40.829676    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:24:40.941492 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:40.941422    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:24:41.006870 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.006836    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt684\" (UniqueName: \"kubernetes.io/projected/94ecf556-a2a3-484d-a975-144e65b04bb9-kube-api-access-xt684\") pod \"94ecf556-a2a3-484d-a975-144e65b04bb9\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") "
Jul 24 19:24:41.007052 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.006888    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-model-cache\") pod \"94ecf556-a2a3-484d-a975-144e65b04bb9\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") "
Jul 24 19:24:41.007052 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.006922    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-home\") pod \"94ecf556-a2a3-484d-a975-144e65b04bb9\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") "
Jul 24 19:24:41.007052 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.006938    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94ecf556-a2a3-484d-a975-144e65b04bb9-tls-certs\") pod \"94ecf556-a2a3-484d-a975-144e65b04bb9\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") "
Jul 24 19:24:41.007052 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.006964    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-tmp-dir\") pod \"94ecf556-a2a3-484d-a975-144e65b04bb9\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") "
Jul 24 19:24:41.007052 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.006980    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-dshm\") pod \"94ecf556-a2a3-484d-a975-144e65b04bb9\" (UID: \"94ecf556-a2a3-484d-a975-144e65b04bb9\") "
Jul 24 19:24:41.007336 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.007170    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-home" (OuterVolumeSpecName: "home") pod "94ecf556-a2a3-484d-a975-144e65b04bb9" (UID: "94ecf556-a2a3-484d-a975-144e65b04bb9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:24:41.007336 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.007233    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-model-cache" (OuterVolumeSpecName: "model-cache") pod "94ecf556-a2a3-484d-a975-144e65b04bb9" (UID: "94ecf556-a2a3-484d-a975-144e65b04bb9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:24:41.007336 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.007243    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "94ecf556-a2a3-484d-a975-144e65b04bb9" (UID: "94ecf556-a2a3-484d-a975-144e65b04bb9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:24:41.009043 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.009014    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94ecf556-a2a3-484d-a975-144e65b04bb9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "94ecf556-a2a3-484d-a975-144e65b04bb9" (UID: "94ecf556-a2a3-484d-a975-144e65b04bb9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:24:41.009171 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.009043    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-dshm" (OuterVolumeSpecName: "dshm") pod "94ecf556-a2a3-484d-a975-144e65b04bb9" (UID: "94ecf556-a2a3-484d-a975-144e65b04bb9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:24:41.009171 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.009137    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ecf556-a2a3-484d-a975-144e65b04bb9-kube-api-access-xt684" (OuterVolumeSpecName: "kube-api-access-xt684") pod "94ecf556-a2a3-484d-a975-144e65b04bb9" (UID: "94ecf556-a2a3-484d-a975-144e65b04bb9"). InnerVolumeSpecName "kube-api-access-xt684". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:24:41.107994 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.107952    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt684\" (UniqueName: \"kubernetes.io/projected/94ecf556-a2a3-484d-a975-144e65b04bb9-kube-api-access-xt684\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:24:41.107994 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.107989    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-model-cache\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:24:41.107994 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.108001    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-home\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:24:41.108248 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.108015    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94ecf556-a2a3-484d-a975-144e65b04bb9-tls-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:24:41.108248 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.108026    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-tmp-dir\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:24:41.108248 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.108036    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94ecf556-a2a3-484d-a975-144e65b04bb9-dshm\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:24:41.731890 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.731856    2557 generic.go:356] "Generic (PLEG): container finished" podID="94ecf556-a2a3-484d-a975-144e65b04bb9" containerID="7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16" exitCode=0
Jul 24 19:24:41.732437 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.731895    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"
Jul 24 19:24:41.732437 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.731933    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5" event={"ID":"94ecf556-a2a3-484d-a975-144e65b04bb9","Type":"ContainerDied","Data":"7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16"}
Jul 24 19:24:41.732437 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.731976    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5" event={"ID":"94ecf556-a2a3-484d-a975-144e65b04bb9","Type":"ContainerDied","Data":"78f1fde894014a64e4f4703b7cc62ed45ec208a2b4c32a1565d6b8ef049a8e54"}
Jul 24 19:24:41.732437 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.731995    2557 scope.go:117] "RemoveContainer" containerID="7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16"
Jul 24 19:24:41.741827 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.741804    2557 scope.go:117] "RemoveContainer" containerID="7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16"
Jul 24 19:24:41.742136 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:24:41.742116    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16\": container with ID starting with 7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16 not found: ID does not exist" containerID="7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16"
Jul 24 19:24:41.742214 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.742146    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16"} err="failed to get container status \"7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16\": rpc error: code = NotFound desc = could not find container \"7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16\": container with ID starting with 7eaf0305e29120cd17efa39268e8d2cf6d4a10df07948f081507c237c8a4bd16 not found: ID does not exist"
Jul 24 19:24:41.754325 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.754295    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"]
Jul 24 19:24:41.760181 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:41.760154    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/sub-test-model-65184f-kserve-6887756c5-gb2w5"]
Jul 24 19:24:42.626232 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:42.626197    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ecf556-a2a3-484d-a975-144e65b04bb9" path="/var/lib/kubelet/pods/94ecf556-a2a3-484d-a975-144e65b04bb9/volumes"
Jul 24 19:24:54.853984 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.853945    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"]
Jul 24 19:24:54.854584 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.854433    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ecf556-a2a3-484d-a975-144e65b04bb9" containerName="main"
Jul 24 19:24:54.854584 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.854578    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ecf556-a2a3-484d-a975-144e65b04bb9" containerName="main"
Jul 24 19:24:54.854809 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.854729    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="94ecf556-a2a3-484d-a975-144e65b04bb9" containerName="main"
Jul 24 19:24:54.857347 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.857328    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:54.860915 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.860892    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d391c5\"/\"default-dockercfg-2gq2j\""
Jul 24 19:24:54.861032 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.860907    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d391c5\"/\"kube-root-ca.crt\""
Jul 24 19:24:54.861032 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.860963    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d391c5\"/\"rate-test-model-d391c5-kserve-self-signed-certs\""
Jul 24 19:24:54.861032 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.860921    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d391c5\"/\"openshift-service-ca.crt\""
Jul 24 19:24:54.867811 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.867788    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"]
Jul 24 19:24:54.875073 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.875048    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:24:54.933948 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.933913    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-model-cache\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:54.934113 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.933957    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx62j\" (UniqueName: \"kubernetes.io/projected/2373aa34-6b95-4ccb-8177-b91d17304004-kube-api-access-bx62j\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:54.934113 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.933978    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-home\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:54.934113 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.934081    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2373aa34-6b95-4ccb-8177-b91d17304004-tls-certs\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:54.934222 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.934118    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-dshm\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:54.934222 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:54.934139    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-tmp-dir\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.034744 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.034708    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-model-cache\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.034912 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.034751    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx62j\" (UniqueName: \"kubernetes.io/projected/2373aa34-6b95-4ccb-8177-b91d17304004-kube-api-access-bx62j\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.034912 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.034880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-home\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.035005 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.034947    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2373aa34-6b95-4ccb-8177-b91d17304004-tls-certs\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.035005 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.034973    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-dshm\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.035005 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.034991    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-tmp-dir\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.035148 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.035118    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-model-cache\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.035236 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.035213    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-home\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.035300 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.035242    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-tmp-dir\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.037209 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.037186    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-dshm\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.037609 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.037586    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2373aa34-6b95-4ccb-8177-b91d17304004-tls-certs\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.042726 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.042695    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx62j\" (UniqueName: \"kubernetes.io/projected/2373aa34-6b95-4ccb-8177-b91d17304004-kube-api-access-bx62j\") pod \"rate-test-model-d391c5-kserve-56c64d7667-rdgsk\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") " pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.168331 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.168232    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:24:55.307659 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.307633    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"]
Jul 24 19:24:55.309663 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:24:55.309632    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2373aa34_6b95_4ccb_8177_b91d17304004.slice/crio-fcd6240542e37181e44766e89ab77687d0b1982f281ef7acfd1a62919ff1d2c7 WatchSource:0}: Error finding container fcd6240542e37181e44766e89ab77687d0b1982f281ef7acfd1a62919ff1d2c7: Status 404 returned error can't find the container with id fcd6240542e37181e44766e89ab77687d0b1982f281ef7acfd1a62919ff1d2c7
Jul 24 19:24:55.808078 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.808039    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk" event={"ID":"2373aa34-6b95-4ccb-8177-b91d17304004","Type":"ContainerStarted","Data":"c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d"}
Jul 24 19:24:55.808078 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.808081    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk" event={"ID":"2373aa34-6b95-4ccb-8177-b91d17304004","Type":"ContainerStarted","Data":"fcd6240542e37181e44766e89ab77687d0b1982f281ef7acfd1a62919ff1d2c7"}
Jul 24 19:24:55.824486 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:55.824433    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk" podStartSLOduration=1.824414949 podStartE2EDuration="1.824414949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:24:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:24:55.823817125 +0000 UTC m=+2683.748769724" watchObservedRunningTime="2026-07-24 19:24:55.824414949 +0000 UTC m=+2683.749367539"
Jul 24 19:24:58.437911 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:24:58.437874    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:25:05.168823 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:05.168727    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:25:05.168823 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:05.168801    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:25:05.181255 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:05.181226    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:25:05.866447 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:05.866418    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:25:12.894588 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:12.894554    2557 scope.go:117] "RemoveContainer" containerID="acf25828397bea98035ce237d66323f9da1c65946d72fd579d0b68678b919d99"
Jul 24 19:25:13.326696 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:13.326659    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:25:28.031989 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:28.031946    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:25:33.298627 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:33.298578    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:35.206069 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:35.206037    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:36.064762 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:36.064724    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"]
Jul 24 19:25:36.081998 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:36.081966    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:37.009081 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:37.009043    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7690-139959303543856"]
Jul 24 19:25:37.012571 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:37.012548    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303543856"
Jul 24 19:25:37.014944 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:37.014919    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9k27v\""
Jul 24 19:25:37.015465 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:37.015436    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7690-139959303543856"]
Jul 24 19:25:37.106064 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:37.106033    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpcxw\" (UniqueName: \"kubernetes.io/projected/7af4e045-4794-463d-a156-7c593fd8a013-kube-api-access-jpcxw\") pod \"test-curl-7690-139959303543856\" (UID: \"7af4e045-4794-463d-a156-7c593fd8a013\") " pod="opendatahub/test-curl-7690-139959303543856"
Jul 24 19:25:37.207128 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:37.207090    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpcxw\" (UniqueName: \"kubernetes.io/projected/7af4e045-4794-463d-a156-7c593fd8a013-kube-api-access-jpcxw\") pod \"test-curl-7690-139959303543856\" (UID: \"7af4e045-4794-463d-a156-7c593fd8a013\") " pod="opendatahub/test-curl-7690-139959303543856"
Jul 24 19:25:37.216402 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:37.216363    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpcxw\" (UniqueName: \"kubernetes.io/projected/7af4e045-4794-463d-a156-7c593fd8a013-kube-api-access-jpcxw\") pod \"test-curl-7690-139959303543856\" (UID: \"7af4e045-4794-463d-a156-7c593fd8a013\") " pod="opendatahub/test-curl-7690-139959303543856"
Jul 24 19:25:37.323164 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:37.323083    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303543856"
Jul 24 19:25:37.455612 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:37.455586    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7690-139959303543856"]
Jul 24 19:25:37.457536 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:25:37.457513    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7af4e045_4794_463d_a156_7c593fd8a013.slice/crio-5c69793dd133f0561d1b797154de3fb1f0637fa5e296ea43c1ef21c8320b8209 WatchSource:0}: Error finding container 5c69793dd133f0561d1b797154de3fb1f0637fa5e296ea43c1ef21c8320b8209: Status 404 returned error can't find the container with id 5c69793dd133f0561d1b797154de3fb1f0637fa5e296ea43c1ef21c8320b8209
Jul 24 19:25:37.458871 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:37.458850    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:25:38.018626 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:38.018586    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7690-139959303543856" event={"ID":"7af4e045-4794-463d-a156-7c593fd8a013","Type":"ContainerStarted","Data":"5c69793dd133f0561d1b797154de3fb1f0637fa5e296ea43c1ef21c8320b8209"}
Jul 24 19:25:39.024553 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:39.024516    2557 generic.go:356] "Generic (PLEG): container finished" podID="7af4e045-4794-463d-a156-7c593fd8a013" containerID="b8f2df685b83376cf5cec594ba203ca9c4b03f0949f8e7649a35b9e00f6d4f4f" exitCode=0
Jul 24 19:25:39.024959 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:39.024561    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7690-139959303543856" event={"ID":"7af4e045-4794-463d-a156-7c593fd8a013","Type":"ContainerDied","Data":"b8f2df685b83376cf5cec594ba203ca9c4b03f0949f8e7649a35b9e00f6d4f4f"}
Jul 24 19:25:40.166633 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.166604    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303543856"
Jul 24 19:25:40.186370 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.186339    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7690-139959303543856_7af4e045-4794-463d-a156-7c593fd8a013/test-curl-7690-139959303543856/0.log"
Jul 24 19:25:40.210763 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.210730    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7690-139959303543856"]
Jul 24 19:25:40.217704 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.217663    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7690-139959303543856"]
Jul 24 19:25:40.234821 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.234782    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpcxw\" (UniqueName: \"kubernetes.io/projected/7af4e045-4794-463d-a156-7c593fd8a013-kube-api-access-jpcxw\") pod \"7af4e045-4794-463d-a156-7c593fd8a013\" (UID: \"7af4e045-4794-463d-a156-7c593fd8a013\") "
Jul 24 19:25:40.237036 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.237007    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af4e045-4794-463d-a156-7c593fd8a013-kube-api-access-jpcxw" (OuterVolumeSpecName: "kube-api-access-jpcxw") pod "7af4e045-4794-463d-a156-7c593fd8a013" (UID: "7af4e045-4794-463d-a156-7c593fd8a013"). InnerVolumeSpecName "kube-api-access-jpcxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:25:40.330485 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.330392    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7690-139959303541680"]
Jul 24 19:25:40.330777 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.330763    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7af4e045-4794-463d-a156-7c593fd8a013" containerName="test-curl-7690-139959303543856"
Jul 24 19:25:40.330822 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.330779    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7af4e045-4794-463d-a156-7c593fd8a013" containerName="test-curl-7690-139959303543856"
Jul 24 19:25:40.330862 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.330853    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7af4e045-4794-463d-a156-7c593fd8a013" containerName="test-curl-7690-139959303543856"
Jul 24 19:25:40.333788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.333767    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303541680"
Jul 24 19:25:40.336052 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.336021    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpcxw\" (UniqueName: \"kubernetes.io/projected/7af4e045-4794-463d-a156-7c593fd8a013-kube-api-access-jpcxw\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:25:40.338933 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.338866    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7690-139959303541680"]
Jul 24 19:25:40.436828 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.436794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw4pf\" (UniqueName: \"kubernetes.io/projected/e0080939-c36c-4df1-883b-5a27c9223bf1-kube-api-access-fw4pf\") pod \"test-curl-7690-139959303541680\" (UID: \"e0080939-c36c-4df1-883b-5a27c9223bf1\") " pod="opendatahub/test-curl-7690-139959303541680"
Jul 24 19:25:40.537773 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.537736    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw4pf\" (UniqueName: \"kubernetes.io/projected/e0080939-c36c-4df1-883b-5a27c9223bf1-kube-api-access-fw4pf\") pod \"test-curl-7690-139959303541680\" (UID: \"e0080939-c36c-4df1-883b-5a27c9223bf1\") " pod="opendatahub/test-curl-7690-139959303541680"
Jul 24 19:25:40.546233 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.546202    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw4pf\" (UniqueName: \"kubernetes.io/projected/e0080939-c36c-4df1-883b-5a27c9223bf1-kube-api-access-fw4pf\") pod \"test-curl-7690-139959303541680\" (UID: \"e0080939-c36c-4df1-883b-5a27c9223bf1\") " pod="opendatahub/test-curl-7690-139959303541680"
Jul 24 19:25:40.622642 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.622559    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7af4e045-4794-463d-a156-7c593fd8a013" path="/var/lib/kubelet/pods/7af4e045-4794-463d-a156-7c593fd8a013/volumes"
Jul 24 19:25:40.644436 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.644401    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303541680"
Jul 24 19:25:40.778499 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:40.778465    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7690-139959303541680"]
Jul 24 19:25:40.779980 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:25:40.779947    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0080939_c36c_4df1_883b_5a27c9223bf1.slice/crio-7b11cf901cd9820b4acc50e73f50d35840b3c03fd71eeff5eab6610603793ce2 WatchSource:0}: Error finding container 7b11cf901cd9820b4acc50e73f50d35840b3c03fd71eeff5eab6610603793ce2: Status 404 returned error can't find the container with id 7b11cf901cd9820b4acc50e73f50d35840b3c03fd71eeff5eab6610603793ce2
Jul 24 19:25:41.036074 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:41.036030    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7690-139959303541680" event={"ID":"e0080939-c36c-4df1-883b-5a27c9223bf1","Type":"ContainerStarted","Data":"7b11cf901cd9820b4acc50e73f50d35840b3c03fd71eeff5eab6610603793ce2"}
Jul 24 19:25:41.037300 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:41.037276    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303543856"
Jul 24 19:25:41.037450 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:41.037304    2557 scope.go:117] "RemoveContainer" containerID="b8f2df685b83376cf5cec594ba203ca9c4b03f0949f8e7649a35b9e00f6d4f4f"
Jul 24 19:25:42.043812 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:42.043780    2557 generic.go:356] "Generic (PLEG): container finished" podID="e0080939-c36c-4df1-883b-5a27c9223bf1" containerID="87517f636dae291ab771b836bee951ccc531ad8e05bcb8806c3a60396514f9be" exitCode=0
Jul 24 19:25:42.044260 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:42.043856    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7690-139959303541680" event={"ID":"e0080939-c36c-4df1-883b-5a27c9223bf1","Type":"ContainerDied","Data":"87517f636dae291ab771b836bee951ccc531ad8e05bcb8806c3a60396514f9be"}
Jul 24 19:25:42.123479 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:42.123440    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:25:43.185109 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.185078    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303541680"
Jul 24 19:25:43.205767 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.205741    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7690-139959303541680_e0080939-c36c-4df1-883b-5a27c9223bf1/test-curl-7690-139959303541680/0.log"
Jul 24 19:25:43.232141 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.232103    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7690-139959303541680"]
Jul 24 19:25:43.234324 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.234294    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7690-139959303541680"]
Jul 24 19:25:43.263608 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.263579    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw4pf\" (UniqueName: \"kubernetes.io/projected/e0080939-c36c-4df1-883b-5a27c9223bf1-kube-api-access-fw4pf\") pod \"e0080939-c36c-4df1-883b-5a27c9223bf1\" (UID: \"e0080939-c36c-4df1-883b-5a27c9223bf1\") "
Jul 24 19:25:43.265627 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.265598    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0080939-c36c-4df1-883b-5a27c9223bf1-kube-api-access-fw4pf" (OuterVolumeSpecName: "kube-api-access-fw4pf") pod "e0080939-c36c-4df1-883b-5a27c9223bf1" (UID: "e0080939-c36c-4df1-883b-5a27c9223bf1"). InnerVolumeSpecName "kube-api-access-fw4pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:25:43.364667 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.364578    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw4pf\" (UniqueName: \"kubernetes.io/projected/e0080939-c36c-4df1-883b-5a27c9223bf1-kube-api-access-fw4pf\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:25:43.397559 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.397528    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7690-139959310141456"]
Jul 24 19:25:43.397880 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.397868    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0080939-c36c-4df1-883b-5a27c9223bf1" containerName="test-curl-7690-139959303541680"
Jul 24 19:25:43.397934 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.397882    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0080939-c36c-4df1-883b-5a27c9223bf1" containerName="test-curl-7690-139959303541680"
Jul 24 19:25:43.397975 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.397946    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0080939-c36c-4df1-883b-5a27c9223bf1" containerName="test-curl-7690-139959303541680"
Jul 24 19:25:43.400750 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.400735    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959310141456"
Jul 24 19:25:43.406674 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.406649    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7690-139959310141456"]
Jul 24 19:25:43.465773 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.465734    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq6mr\" (UniqueName: \"kubernetes.io/projected/af060c40-6bf2-4cd4-bc49-e29ee364f2b4-kube-api-access-lq6mr\") pod \"test-curl-7690-139959310141456\" (UID: \"af060c40-6bf2-4cd4-bc49-e29ee364f2b4\") " pod="opendatahub/test-curl-7690-139959310141456"
Jul 24 19:25:43.567211 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.567178    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq6mr\" (UniqueName: \"kubernetes.io/projected/af060c40-6bf2-4cd4-bc49-e29ee364f2b4-kube-api-access-lq6mr\") pod \"test-curl-7690-139959310141456\" (UID: \"af060c40-6bf2-4cd4-bc49-e29ee364f2b4\") " pod="opendatahub/test-curl-7690-139959310141456"
Jul 24 19:25:43.575566 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.575529    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq6mr\" (UniqueName: \"kubernetes.io/projected/af060c40-6bf2-4cd4-bc49-e29ee364f2b4-kube-api-access-lq6mr\") pod \"test-curl-7690-139959310141456\" (UID: \"af060c40-6bf2-4cd4-bc49-e29ee364f2b4\") " pod="opendatahub/test-curl-7690-139959310141456"
Jul 24 19:25:43.711677 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.711643    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959310141456"
Jul 24 19:25:43.852097 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:43.852064    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7690-139959310141456"]
Jul 24 19:25:43.853257 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:25:43.853223    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf060c40_6bf2_4cd4_bc49_e29ee364f2b4.slice/crio-9cfd92e2a62dde7efb5682edada8a5fbe2d7fad2f6c64e48b3b06b4a075909af WatchSource:0}: Error finding container 9cfd92e2a62dde7efb5682edada8a5fbe2d7fad2f6c64e48b3b06b4a075909af: Status 404 returned error can't find the container with id 9cfd92e2a62dde7efb5682edada8a5fbe2d7fad2f6c64e48b3b06b4a075909af
Jul 24 19:25:44.054993 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:44.054908    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b11cf901cd9820b4acc50e73f50d35840b3c03fd71eeff5eab6610603793ce2"
Jul 24 19:25:44.054993 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:44.054913    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303541680"
Jul 24 19:25:44.056209 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:44.056181    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7690-139959310141456" event={"ID":"af060c40-6bf2-4cd4-bc49-e29ee364f2b4","Type":"ContainerStarted","Data":"9cfd92e2a62dde7efb5682edada8a5fbe2d7fad2f6c64e48b3b06b4a075909af"}
Jul 24 19:25:44.065902 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:25:44.065874    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7690-139959303541680\" is forbidden: User \"system:node:ip-10-0-141-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-149.ec2.internal' and this object" podUID="e0080939-c36c-4df1-883b-5a27c9223bf1" pod="opendatahub/test-curl-7690-139959303541680"
Jul 24 19:25:44.621474 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:44.621435    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0080939-c36c-4df1-883b-5a27c9223bf1" path="/var/lib/kubelet/pods/e0080939-c36c-4df1-883b-5a27c9223bf1/volumes"
Jul 24 19:25:45.062807 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:45.062771    2557 generic.go:356] "Generic (PLEG): container finished" podID="af060c40-6bf2-4cd4-bc49-e29ee364f2b4" containerID="225bcea7442c7b019d1b89a884c137782397c4b05c1847572c9ee7a5a779bd87" exitCode=0
Jul 24 19:25:45.062990 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:45.062836    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7690-139959310141456" event={"ID":"af060c40-6bf2-4cd4-bc49-e29ee364f2b4","Type":"ContainerDied","Data":"225bcea7442c7b019d1b89a884c137782397c4b05c1847572c9ee7a5a779bd87"}
Jul 24 19:25:46.208527 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:46.208501    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959310141456"
Jul 24 19:25:46.229447 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:46.229413    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7690-139959310141456_af060c40-6bf2-4cd4-bc49-e29ee364f2b4/test-curl-7690-139959310141456/0.log"
Jul 24 19:25:46.251909 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:46.251869    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7690-139959310141456"]
Jul 24 19:25:46.255593 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:46.255566    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7690-139959310141456"]
Jul 24 19:25:46.291367 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:46.291334    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq6mr\" (UniqueName: \"kubernetes.io/projected/af060c40-6bf2-4cd4-bc49-e29ee364f2b4-kube-api-access-lq6mr\") pod \"af060c40-6bf2-4cd4-bc49-e29ee364f2b4\" (UID: \"af060c40-6bf2-4cd4-bc49-e29ee364f2b4\") "
Jul 24 19:25:46.293438 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:46.293413    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af060c40-6bf2-4cd4-bc49-e29ee364f2b4-kube-api-access-lq6mr" (OuterVolumeSpecName: "kube-api-access-lq6mr") pod "af060c40-6bf2-4cd4-bc49-e29ee364f2b4" (UID: "af060c40-6bf2-4cd4-bc49-e29ee364f2b4"). InnerVolumeSpecName "kube-api-access-lq6mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:25:46.392861 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:46.392777    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq6mr\" (UniqueName: \"kubernetes.io/projected/af060c40-6bf2-4cd4-bc49-e29ee364f2b4-kube-api-access-lq6mr\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:25:46.622035 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:46.622001    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af060c40-6bf2-4cd4-bc49-e29ee364f2b4" path="/var/lib/kubelet/pods/af060c40-6bf2-4cd4-bc49-e29ee364f2b4/volumes"
Jul 24 19:25:47.073542 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:47.073515    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959310141456"
Jul 24 19:25:47.073719 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:47.073563    2557 scope.go:117] "RemoveContainer" containerID="225bcea7442c7b019d1b89a884c137782397c4b05c1847572c9ee7a5a779bd87"
Jul 24 19:25:51.084311 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.084238    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk" podUID="2373aa34-6b95-4ccb-8177-b91d17304004" containerName="main" containerID="cri-o://c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d" gracePeriod=45
Jul 24 19:25:51.339584 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.339520    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:25:51.439824 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.439784    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-home\") pod \"2373aa34-6b95-4ccb-8177-b91d17304004\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") "
Jul 24 19:25:51.439824 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.439827    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2373aa34-6b95-4ccb-8177-b91d17304004-tls-certs\") pod \"2373aa34-6b95-4ccb-8177-b91d17304004\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") "
Jul 24 19:25:51.440086 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.439884    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx62j\" (UniqueName: \"kubernetes.io/projected/2373aa34-6b95-4ccb-8177-b91d17304004-kube-api-access-bx62j\") pod \"2373aa34-6b95-4ccb-8177-b91d17304004\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") "
Jul 24 19:25:51.440086 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.439899    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-tmp-dir\") pod \"2373aa34-6b95-4ccb-8177-b91d17304004\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") "
Jul 24 19:25:51.440086 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.439977    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-model-cache\") pod \"2373aa34-6b95-4ccb-8177-b91d17304004\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") "
Jul 24 19:25:51.440086 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.440053    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-dshm\") pod \"2373aa34-6b95-4ccb-8177-b91d17304004\" (UID: \"2373aa34-6b95-4ccb-8177-b91d17304004\") "
Jul 24 19:25:51.440297 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.440081    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-home" (OuterVolumeSpecName: "home") pod "2373aa34-6b95-4ccb-8177-b91d17304004" (UID: "2373aa34-6b95-4ccb-8177-b91d17304004"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:25:51.440297 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.440188    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2373aa34-6b95-4ccb-8177-b91d17304004" (UID: "2373aa34-6b95-4ccb-8177-b91d17304004"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:25:51.440297 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.440265    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-model-cache" (OuterVolumeSpecName: "model-cache") pod "2373aa34-6b95-4ccb-8177-b91d17304004" (UID: "2373aa34-6b95-4ccb-8177-b91d17304004"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:25:51.440453 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.440435    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-home\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:25:51.440498 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.440480    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-tmp-dir\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:25:51.440498 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.440494    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-model-cache\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:25:51.442263 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.442236    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-dshm" (OuterVolumeSpecName: "dshm") pod "2373aa34-6b95-4ccb-8177-b91d17304004" (UID: "2373aa34-6b95-4ccb-8177-b91d17304004"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:25:51.442357 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.442303    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2373aa34-6b95-4ccb-8177-b91d17304004-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2373aa34-6b95-4ccb-8177-b91d17304004" (UID: "2373aa34-6b95-4ccb-8177-b91d17304004"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:25:51.442357 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.442320    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2373aa34-6b95-4ccb-8177-b91d17304004-kube-api-access-bx62j" (OuterVolumeSpecName: "kube-api-access-bx62j") pod "2373aa34-6b95-4ccb-8177-b91d17304004" (UID: "2373aa34-6b95-4ccb-8177-b91d17304004"). InnerVolumeSpecName "kube-api-access-bx62j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:25:51.541269 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.541233    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx62j\" (UniqueName: \"kubernetes.io/projected/2373aa34-6b95-4ccb-8177-b91d17304004-kube-api-access-bx62j\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:25:51.541269 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.541264    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2373aa34-6b95-4ccb-8177-b91d17304004-dshm\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:25:51.541269 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:51.541275    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2373aa34-6b95-4ccb-8177-b91d17304004-tls-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:25:52.100872 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:52.100834    2557 generic.go:356] "Generic (PLEG): container finished" podID="2373aa34-6b95-4ccb-8177-b91d17304004" containerID="c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d" exitCode=0
Jul 24 19:25:52.100872 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:52.100878    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"
Jul 24 19:25:52.101334 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:52.100925    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk" event={"ID":"2373aa34-6b95-4ccb-8177-b91d17304004","Type":"ContainerDied","Data":"c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d"}
Jul 24 19:25:52.101334 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:52.100967    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk" event={"ID":"2373aa34-6b95-4ccb-8177-b91d17304004","Type":"ContainerDied","Data":"fcd6240542e37181e44766e89ab77687d0b1982f281ef7acfd1a62919ff1d2c7"}
Jul 24 19:25:52.101334 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:52.100989    2557 scope.go:117] "RemoveContainer" containerID="c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d"
Jul 24 19:25:52.110195 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:52.110178    2557 scope.go:117] "RemoveContainer" containerID="c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d"
Jul 24 19:25:52.110461 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:25:52.110442    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d\": container with ID starting with c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d not found: ID does not exist" containerID="c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d"
Jul 24 19:25:52.110500 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:52.110470    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d"} err="failed to get container status \"c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d\": rpc error: code = NotFound desc = could not find container \"c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d\": container with ID starting with c5247f48af9c13e085cb9e41d6d272bfd58dc50aab24b759bd5bf7ec28057a7d not found: ID does not exist"
Jul 24 19:25:52.122473 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:52.122448    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"]
Jul 24 19:25:52.126391 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:52.126349    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/rate-test-model-d391c5-kserve-56c64d7667-rdgsk"]
Jul 24 19:25:52.623242 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:52.623212    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2373aa34-6b95-4ccb-8177-b91d17304004" path="/var/lib/kubelet/pods/2373aa34-6b95-4ccb-8177-b91d17304004/volumes"
Jul 24 19:25:55.927251 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:55.927217    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:56.226798 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.226758    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"]
Jul 24 19:25:56.227289 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.227262    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af060c40-6bf2-4cd4-bc49-e29ee364f2b4" containerName="test-curl-7690-139959310141456"
Jul 24 19:25:56.227477 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.227460    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="af060c40-6bf2-4cd4-bc49-e29ee364f2b4" containerName="test-curl-7690-139959310141456"
Jul 24 19:25:56.227591 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.227580    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2373aa34-6b95-4ccb-8177-b91d17304004" containerName="main"
Jul 24 19:25:56.227689 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.227671    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2373aa34-6b95-4ccb-8177-b91d17304004" containerName="main"
Jul 24 19:25:56.227948 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.227933    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2373aa34-6b95-4ccb-8177-b91d17304004" containerName="main"
Jul 24 19:25:56.228018 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.227954    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="af060c40-6bf2-4cd4-bc49-e29ee364f2b4" containerName="test-curl-7690-139959310141456"
Jul 24 19:25:56.232234 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.232215    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.234932 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.234914    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-2d5d53-openshift-default-dockercfg-mn8f9\""
Jul 24 19:25:56.241728 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.241705    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"]
Jul 24 19:25:56.249558 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.249527    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:56.282520 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.282483    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nf69\" (UniqueName: \"kubernetes.io/projected/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-kube-api-access-4nf69\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.282520 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.282527    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-workload-certs\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.282751 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.282622    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istiod-ca-cert\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.282751 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.282678    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-podinfo\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.282751 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.282738    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-envoy\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.282865 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.282767    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-token\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.282865 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.282801    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-credential-socket\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.282865 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.282852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-workload-socket\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.282983 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.282877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-data\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.383849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.383804    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istiod-ca-cert\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.383849 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.383849    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-podinfo\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.384109 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.383899    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-envoy\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.384109 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.383926    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-token\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.384109 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.383960    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-credential-socket\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.384109 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.384003    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-workload-socket\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.384109 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.384029    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-data\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.384370 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.384345    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-data\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.384468 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.384415    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nf69\" (UniqueName: \"kubernetes.io/projected/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-kube-api-access-4nf69\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.384522 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.384475    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-workload-certs\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.384585 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.384521    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-credential-socket\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.384735 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.384713    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istiod-ca-cert\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.384873 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.384753    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-workload-socket\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.384873 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.384767    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-workload-certs\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.386326 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.386304    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-envoy\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.386668 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.386640    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-podinfo\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.391878 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.391853    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-token\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.392649 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.392630    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nf69\" (UniqueName: \"kubernetes.io/projected/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-kube-api-access-4nf69\") pod \"e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") " pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.544624 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.544538    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:56.572961 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.572922    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:56.688558 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.688531    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"]
Jul 24 19:25:56.691336 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:25:56.691307    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eab5c8b_261c_4b18_a10d_284ff0fe2eb4.slice/crio-6cb6c3a2af971f96723b7dc5bb4ba0ec3e1178db8df5d8bfcc9658fe24e0d40a WatchSource:0}: Error finding container 6cb6c3a2af971f96723b7dc5bb4ba0ec3e1178db8df5d8bfcc9658fe24e0d40a: Status 404 returned error can't find the container with id 6cb6c3a2af971f96723b7dc5bb4ba0ec3e1178db8df5d8bfcc9658fe24e0d40a
Jul 24 19:25:56.693655 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.693614    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:25:56.693754 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.693704    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:25:56.693754 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:56.693744    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:25:57.135359 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:57.135323    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" event={"ID":"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4","Type":"ContainerStarted","Data":"63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9"}
Jul 24 19:25:57.135781 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:57.135413    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" event={"ID":"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4","Type":"ContainerStarted","Data":"6cb6c3a2af971f96723b7dc5bb4ba0ec3e1178db8df5d8bfcc9658fe24e0d40a"}
Jul 24 19:25:57.159021 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:57.158961    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" podStartSLOduration=1.158940088 podStartE2EDuration="1.158940088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:25:57.157309306 +0000 UTC m=+2745.082261910" watchObservedRunningTime="2026-07-24 19:25:57.158940088 +0000 UTC m=+2745.083892684"
Jul 24 19:25:57.544978 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:57.544929    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:57.550149 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:57.550120    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:58.140522 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:58.140490    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:58.141515 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:58.141494    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:25:59.071102 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:59.071069    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:59.155940 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:59.155905    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:59.226027 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:59.225992    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:59.350195 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:59.350116    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:59.800098 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:59.800061    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:59.916384 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:25:59.916324    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:03.567587 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:03.567550    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:07.730066 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:07.730027    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:26:12.919262 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:12.919176    2557 scope.go:117] "RemoveContainer" containerID="908e6f8fc3856c477aac7c8c99536ab57d7c2d33139e060649f9cef725458ee5"
Jul 24 19:26:14.182590 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.182546    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 19:26:14.183001 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.182664    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 19:26:14.486587 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.486548    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:14.779799 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.779708    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"]
Jul 24 19:26:14.786455 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.786423    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:14.789481 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.789459    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-8a409a-openshift-default-dockercfg-4bd9b\""
Jul 24 19:26:14.803308 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.803272    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"]
Jul 24 19:26:14.824857 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.824805    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:14.959844 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.959796    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-token\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:14.960021 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.959854    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5j7h\" (UniqueName: \"kubernetes.io/projected/d5eac499-792c-48a9-a15c-e741e0bbaa8f-kube-api-access-j5j7h\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:14.960021 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.959896    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-credential-socket\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:14.960021 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.959943    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-podinfo\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:14.960021 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.959986    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-data\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:14.960256 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.960085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istiod-ca-cert\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:14.960256 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.960125    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-envoy\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:14.960256 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.960213    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-workload-certs\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:14.960394 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:14.960264    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-workload-socket\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.061134 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.061028    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5j7h\" (UniqueName: \"kubernetes.io/projected/d5eac499-792c-48a9-a15c-e741e0bbaa8f-kube-api-access-j5j7h\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.061134 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.061106    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-credential-socket\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.061401 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.061150    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-podinfo\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.061401 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.061204    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-data\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.061401 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.061280    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istiod-ca-cert\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.061401 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.061310    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-envoy\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.061401 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.061362    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-workload-certs\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.061689 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.061421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-workload-socket\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.061689 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.061472    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-token\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.061689 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.061576    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-credential-socket\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.061847 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.061697    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-data\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.061847 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.061779    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-workload-certs\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.062113 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.062090    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-workload-socket\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.062440 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.062417    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istiod-ca-cert\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.063685 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.063656    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-envoy\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.063901 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.063881    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-podinfo\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.069119 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.069095    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-token\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.069249 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.069179    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5j7h\" (UniqueName: \"kubernetes.io/projected/d5eac499-792c-48a9-a15c-e741e0bbaa8f-kube-api-access-j5j7h\") pod \"e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") " pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.074712 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.074665    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:15.099012 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.098973    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:15.262925 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.262887    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"]
Jul 24 19:26:15.265212 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:26:15.265151    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5eac499_792c_48a9_a15c_e741e0bbaa8f.slice/crio-8fa982fb9b746c43cdcf0a17c1a1eb285e5941185262bb17e7f7e485869a9463 WatchSource:0}: Error finding container 8fa982fb9b746c43cdcf0a17c1a1eb285e5941185262bb17e7f7e485869a9463: Status 404 returned error can't find the container with id 8fa982fb9b746c43cdcf0a17c1a1eb285e5941185262bb17e7f7e485869a9463
Jul 24 19:26:15.268162 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.268117    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:26:15.268292 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.268209    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:26:15.268292 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:15.268257    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:26:16.254869 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:16.254835    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" event={"ID":"d5eac499-792c-48a9-a15c-e741e0bbaa8f","Type":"ContainerStarted","Data":"408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab"}
Jul 24 19:26:16.255227 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:16.254895    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" event={"ID":"d5eac499-792c-48a9-a15c-e741e0bbaa8f","Type":"ContainerStarted","Data":"8fa982fb9b746c43cdcf0a17c1a1eb285e5941185262bb17e7f7e485869a9463"}
Jul 24 19:26:16.256364 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:16.256340    2557 generic.go:356] "Generic (PLEG): container finished" podID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerID="63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9" exitCode=0
Jul 24 19:26:16.256471 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:16.256420    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" event={"ID":"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4","Type":"ContainerDied","Data":"63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9"}
Jul 24 19:26:16.256762 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:16.256748    2557 scope.go:117] "RemoveContainer" containerID="63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9"
Jul 24 19:26:16.257788 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:16.257763    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:26:16.257858 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:16.257844    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:26:16.257909 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:16.257897    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:26:16.295038 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:16.294986    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" podStartSLOduration=2.294970006 podStartE2EDuration="2.294970006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:26:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:26:16.275509396 +0000 UTC m=+2764.200461990" watchObservedRunningTime="2026-07-24 19:26:16.294970006 +0000 UTC m=+2764.219922600"
Jul 24 19:26:17.099961 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:17.099904    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:17.112692 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:17.112649    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:17.263064 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:17.263029    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" event={"ID":"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4","Type":"ContainerStarted","Data":"89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17"}
Jul 24 19:26:17.263406 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:17.263366    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:17.264256 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:17.264236    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:17.545424 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:17.545366    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:26:17.545903 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:17.545751    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 24 19:26:17.545903 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:17.545795    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 24 19:26:18.230839 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:18.230788    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:18.330210 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:18.330178    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:18.434573 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:18.434539    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:18.545936 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:18.545843    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 24 19:26:18.545936 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:18.545899    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 24 19:26:18.787504 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:18.787464    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:18.922069 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:18.921984    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:19.019102 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:19.019056    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:19.545325 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:19.545291    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 24 19:26:19.545523 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:19.545341    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 24 19:26:20.545116 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:20.545077    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 24 19:26:20.545555 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:20.545134    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 24 19:26:21.548911 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:21.548876    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:26:21.549427 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:21.549152    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:26:21.549994 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:21.549978    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:26:22.721460 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:22.721424    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:26.122515 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:26.122478    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:26:33.303601 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:33.303557    2557 patch_prober.go:28] interesting pod/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 19:26:33.304008 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:33.303634    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 19:26:34.358038 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:34.358001    2557 generic.go:356] "Generic (PLEG): container finished" podID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerID="408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab" exitCode=0
Jul 24 19:26:34.358530 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:34.358044    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" event={"ID":"d5eac499-792c-48a9-a15c-e741e0bbaa8f","Type":"ContainerDied","Data":"408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab"}
Jul 24 19:26:34.358530 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:34.358506    2557 scope.go:117] "RemoveContainer" containerID="408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab"
Jul 24 19:26:34.359786 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:34.359758    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:26:34.359856 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:34.359829    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:26:34.359894 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:34.359872    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:26:35.365110 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:35.365076    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" event={"ID":"d5eac499-792c-48a9-a15c-e741e0bbaa8f","Type":"ContainerStarted","Data":"d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb"}
Jul 24 19:26:36.100072 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:36.100028    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:36.100308 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:36.100090    2557 patch_prober.go:28] interesting pod/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 24 19:26:36.100308 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:36.100159    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 24 19:26:37.099707 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:37.099665    2557 patch_prober.go:28] interesting pod/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 24 19:26:37.100351 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:37.100314    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 24 19:26:38.099829 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:38.099784    2557 patch_prober.go:28] interesting pod/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 24 19:26:38.100418 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:38.099860    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 24 19:26:39.100490 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:39.100443    2557 patch_prober.go:28] interesting pod/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 24 19:26:39.101122 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:39.100503    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 24 19:26:40.102838 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:40.102798    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:40.103278 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:40.103207    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:40.103812 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:40.103791    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:26:47.099301 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:47.099265    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:50.826585 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:26:50.826549    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:27:09.731794 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:09.731755    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:27:22.290110 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:22.290076    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:22.592952 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:22.592858    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:22.835740 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:22.835705    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:25.756084 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:25.756049    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:25.846657 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:25.846594    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:25.914015 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:25.913982    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:26.059522 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:26.059438    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:26.449953 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:26.449865    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:26.547267 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:26.547235    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:30.148097 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:30.148064    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:31.321349 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:31.321307    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:27:41.050575 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:41.050534    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj"]
Jul 24 19:27:41.054035 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:41.054016    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj"
Jul 24 19:27:41.056588 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:41.056568    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:27:41.056692 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:41.056647    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:27:41.061628 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:41.061592    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj"]
Jul 24 19:27:41.066639 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:41.066609    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c87b52-d2d1-472c-aa46-926b7db0087a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj\" (UID: \"e0c87b52-d2d1-472c-aa46-926b7db0087a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj"
Jul 24 19:27:41.167476 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:41.167435    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c87b52-d2d1-472c-aa46-926b7db0087a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj\" (UID: \"e0c87b52-d2d1-472c-aa46-926b7db0087a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj"
Jul 24 19:27:41.168051 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:41.168031    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c87b52-d2d1-472c-aa46-926b7db0087a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj\" (UID: \"e0c87b52-d2d1-472c-aa46-926b7db0087a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj"
Jul 24 19:27:41.366873 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:41.366780    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj"
Jul 24 19:27:41.505140 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:41.505105    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj"]
Jul 24 19:27:41.507138 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:27:41.507106    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c87b52_d2d1_472c_aa46_926b7db0087a.slice/crio-5c128be894da8e46264c16de704e756a09ec184f41aedb23be1f63c42ca8529d WatchSource:0}: Error finding container 5c128be894da8e46264c16de704e756a09ec184f41aedb23be1f63c42ca8529d: Status 404 returned error can't find the container with id 5c128be894da8e46264c16de704e756a09ec184f41aedb23be1f63c42ca8529d
Jul 24 19:27:41.699598 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:41.699519    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj" event={"ID":"e0c87b52-d2d1-472c-aa46-926b7db0087a","Type":"ContainerStarted","Data":"5c128be894da8e46264c16de704e756a09ec184f41aedb23be1f63c42ca8529d"}
Jul 24 19:27:42.706383 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:42.706335    2557 generic.go:356] "Generic (PLEG): container finished" podID="e0c87b52-d2d1-472c-aa46-926b7db0087a" containerID="8a4984d49066760d4f7747ba9b318d4689eb78c10eb8a98b3d94a0bf42f8ed91" exitCode=0
Jul 24 19:27:42.706806 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:42.706423    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj" event={"ID":"e0c87b52-d2d1-472c-aa46-926b7db0087a","Type":"ContainerDied","Data":"8a4984d49066760d4f7747ba9b318d4689eb78c10eb8a98b3d94a0bf42f8ed91"}
Jul 24 19:27:43.845595 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:43.845571    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj"
Jul 24 19:27:43.891817 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:43.891780    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c87b52-d2d1-472c-aa46-926b7db0087a-maas-api-service-ca\") pod \"e0c87b52-d2d1-472c-aa46-926b7db0087a\" (UID: \"e0c87b52-d2d1-472c-aa46-926b7db0087a\") "
Jul 24 19:27:43.892155 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:43.892131    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0c87b52-d2d1-472c-aa46-926b7db0087a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e0c87b52-d2d1-472c-aa46-926b7db0087a" (UID: "e0c87b52-d2d1-472c-aa46-926b7db0087a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:27:43.992931 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:43.992845    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c87b52-d2d1-472c-aa46-926b7db0087a-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:27:44.719823 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:44.719784    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj" event={"ID":"e0c87b52-d2d1-472c-aa46-926b7db0087a","Type":"ContainerDied","Data":"5c128be894da8e46264c16de704e756a09ec184f41aedb23be1f63c42ca8529d"}
Jul 24 19:27:44.719999 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:44.719835    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c128be894da8e46264c16de704e756a09ec184f41aedb23be1f63c42ca8529d"
Jul 24 19:27:44.719999 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:44.719798    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj"
Jul 24 19:27:51.606878 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:51.606846    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:51.685096 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:51.685066    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:51.741951 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:51.741915    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:56.132587 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:56.132547    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj"]
Jul 24 19:27:56.135098 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:56.135069    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:56.135484 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:56.135466    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9cf26b-hzhsj"]
Jul 24 19:27:56.547092 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:56.547056    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:56.623023 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:56.622991    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0c87b52-d2d1-472c-aa46-926b7db0087a" path="/var/lib/kubelet/pods/e0c87b52-d2d1-472c-aa46-926b7db0087a/volumes"
Jul 24 19:27:58.232998 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:27:58.232961    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:28:02.231771 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:02.231737    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:03.381279 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:03.381241    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:06.025859 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.025772    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x"]
Jul 24 19:28:06.026232 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.026131    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0c87b52-d2d1-472c-aa46-926b7db0087a" containerName="revoke-keys"
Jul 24 19:28:06.026232 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.026142    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0c87b52-d2d1-472c-aa46-926b7db0087a" containerName="revoke-keys"
Jul 24 19:28:06.026232 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.026209    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0c87b52-d2d1-472c-aa46-926b7db0087a" containerName="revoke-keys"
Jul 24 19:28:06.029411 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.029394    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x"
Jul 24 19:28:06.031745 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.031721    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:28:06.031745 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.031737    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:28:06.036243 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.036217    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x"]
Jul 24 19:28:06.192845 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.192807    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d086383b-87f2-4309-9bd3-f46dd46132e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x\" (UID: \"d086383b-87f2-4309-9bd3-f46dd46132e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x"
Jul 24 19:28:06.293743 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.293658    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d086383b-87f2-4309-9bd3-f46dd46132e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x\" (UID: \"d086383b-87f2-4309-9bd3-f46dd46132e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x"
Jul 24 19:28:06.294272 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.294253    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d086383b-87f2-4309-9bd3-f46dd46132e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x\" (UID: \"d086383b-87f2-4309-9bd3-f46dd46132e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x"
Jul 24 19:28:06.341151 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.341122    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x"
Jul 24 19:28:06.477561 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.477528    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x"]
Jul 24 19:28:06.479167 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:28:06.479134    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd086383b_87f2_4309_9bd3_f46dd46132e5.slice/crio-16cb67faf0200d196ec36049c25a93875fed63f0329f1183a127277e27e5cf0e WatchSource:0}: Error finding container 16cb67faf0200d196ec36049c25a93875fed63f0329f1183a127277e27e5cf0e: Status 404 returned error can't find the container with id 16cb67faf0200d196ec36049c25a93875fed63f0329f1183a127277e27e5cf0e
Jul 24 19:28:06.828453 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.828414    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x" event={"ID":"d086383b-87f2-4309-9bd3-f46dd46132e5","Type":"ContainerStarted","Data":"f676e143d51d63323a8c76b81b5a79e3303652499eeebb19c180a9a21d722784"}
Jul 24 19:28:06.828634 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.828509    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x" event={"ID":"d086383b-87f2-4309-9bd3-f46dd46132e5","Type":"ContainerStarted","Data":"16cb67faf0200d196ec36049c25a93875fed63f0329f1183a127277e27e5cf0e"}
Jul 24 19:28:06.844928 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:06.844880    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x" podStartSLOduration=0.844865813 podStartE2EDuration="844.865813ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:28:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:28:06.8424937 +0000 UTC m=+2874.767446294" watchObservedRunningTime="2026-07-24 19:28:06.844865813 +0000 UTC m=+2874.769818436"
Jul 24 19:28:07.835428 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:07.835366    2557 generic.go:356] "Generic (PLEG): container finished" podID="d086383b-87f2-4309-9bd3-f46dd46132e5" containerID="f676e143d51d63323a8c76b81b5a79e3303652499eeebb19c180a9a21d722784" exitCode=0
Jul 24 19:28:07.835861 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:07.835466    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x" event={"ID":"d086383b-87f2-4309-9bd3-f46dd46132e5","Type":"ContainerDied","Data":"f676e143d51d63323a8c76b81b5a79e3303652499eeebb19c180a9a21d722784"}
Jul 24 19:28:08.973699 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:08.973672    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x"
Jul 24 19:28:09.120443 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:09.120324    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d086383b-87f2-4309-9bd3-f46dd46132e5-maas-api-service-ca\") pod \"d086383b-87f2-4309-9bd3-f46dd46132e5\" (UID: \"d086383b-87f2-4309-9bd3-f46dd46132e5\") "
Jul 24 19:28:09.120769 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:09.120732    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d086383b-87f2-4309-9bd3-f46dd46132e5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d086383b-87f2-4309-9bd3-f46dd46132e5" (UID: "d086383b-87f2-4309-9bd3-f46dd46132e5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:28:09.221395 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:09.221352    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d086383b-87f2-4309-9bd3-f46dd46132e5-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:28:09.846679 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:09.846640    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x"
Jul 24 19:28:09.846679 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:09.846675    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x" event={"ID":"d086383b-87f2-4309-9bd3-f46dd46132e5","Type":"ContainerDied","Data":"16cb67faf0200d196ec36049c25a93875fed63f0329f1183a127277e27e5cf0e"}
Jul 24 19:28:09.846889 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:09.846720    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16cb67faf0200d196ec36049c25a93875fed63f0329f1183a127277e27e5cf0e"
Jul 24 19:28:21.493195 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:21.493153    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:21.571166 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:21.571133    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:21.709748 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:21.709713    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:21.935855 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:21.935767    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:28:26.108655 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:26.108571    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:26.109420 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:26.109398    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x"]
Jul 24 19:28:26.111104 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:26.111082    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2d5d53-65s2x"]
Jul 24 19:28:26.483933 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:26.483898    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:26.621944 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:26.621910    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d086383b-87f2-4309-9bd3-f46dd46132e5" path="/var/lib/kubelet/pods/d086383b-87f2-4309-9bd3-f46dd46132e5/volumes"
Jul 24 19:28:31.514263 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:31.514218    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:31.831166 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:28:31.831077    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:29:07.918505 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:07.918469    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:08.720000 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:08.719964    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:14.408835 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:14.408801    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:17.519725 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:17.519688    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:29.008112 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.008074    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:29.073880 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.073845    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:29.263816 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.263721    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"]
Jul 24 19:29:29.263988 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.263959    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerName="istio-proxy" containerID="cri-o://89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17" gracePeriod=30
Jul 24 19:29:29.281100 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.281069    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:29.517201 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.517088    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:29.636048 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.636015    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr"]
Jul 24 19:29:29.636401 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.636388    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d086383b-87f2-4309-9bd3-f46dd46132e5" containerName="revoke-keys"
Jul 24 19:29:29.636453 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.636404    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d086383b-87f2-4309-9bd3-f46dd46132e5" containerName="revoke-keys"
Jul 24 19:29:29.636495 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.636481    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d086383b-87f2-4309-9bd3-f46dd46132e5" containerName="revoke-keys"
Jul 24 19:29:29.639282 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.639265    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr"
Jul 24 19:29:29.642010 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.641988    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:29:29.642182 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.642171    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:29:29.649606 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.649580    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr"]
Jul 24 19:29:29.744924 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.744886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09f4db16-4441-488f-b5cb-0c3fb1cfa18b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr\" (UID: \"09f4db16-4441-488f-b5cb-0c3fb1cfa18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr"
Jul 24 19:29:29.846303 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.846200    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09f4db16-4441-488f-b5cb-0c3fb1cfa18b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr\" (UID: \"09f4db16-4441-488f-b5cb-0c3fb1cfa18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr"
Jul 24 19:29:29.846858 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.846839    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09f4db16-4441-488f-b5cb-0c3fb1cfa18b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr\" (UID: \"09f4db16-4441-488f-b5cb-0c3fb1cfa18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr"
Jul 24 19:29:29.950076 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:29.950040    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr"
Jul 24 19:29:30.090232 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:30.090180    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr"]
Jul 24 19:29:30.093310 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:29:30.093286    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f4db16_4441_488f_b5cb_0c3fb1cfa18b.slice/crio-03d7df1d7d5a3a3f3f0b434d057fd392d62b737596b5869ec9854a6a83c76109 WatchSource:0}: Error finding container 03d7df1d7d5a3a3f3f0b434d057fd392d62b737596b5869ec9854a6a83c76109: Status 404 returned error can't find the container with id 03d7df1d7d5a3a3f3f0b434d057fd392d62b737596b5869ec9854a6a83c76109
Jul 24 19:29:30.261130 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:30.261092    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr" event={"ID":"09f4db16-4441-488f-b5cb-0c3fb1cfa18b","Type":"ContainerStarted","Data":"03d7df1d7d5a3a3f3f0b434d057fd392d62b737596b5869ec9854a6a83c76109"}
Jul 24 19:29:30.814875 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:29:30.814835    2557 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f4db16_4441_488f_b5cb_0c3fb1cfa18b.slice/crio-conmon-489fbb6286b4836cb6dd04d3fe2c5a2d84a0157b0997b4ee4ff68da39171cb48.scope\": RecentStats: unable to find data in memory cache]"
Jul 24 19:29:31.268707 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:31.268672    2557 generic.go:356] "Generic (PLEG): container finished" podID="09f4db16-4441-488f-b5cb-0c3fb1cfa18b" containerID="489fbb6286b4836cb6dd04d3fe2c5a2d84a0157b0997b4ee4ff68da39171cb48" exitCode=0
Jul 24 19:29:31.269099 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:31.268766    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr" event={"ID":"09f4db16-4441-488f-b5cb-0c3fb1cfa18b","Type":"ContainerDied","Data":"489fbb6286b4836cb6dd04d3fe2c5a2d84a0157b0997b4ee4ff68da39171cb48"}
Jul 24 19:29:32.408583 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:32.408550    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr"
Jul 24 19:29:32.469889 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:32.469859    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09f4db16-4441-488f-b5cb-0c3fb1cfa18b-maas-api-service-ca\") pod \"09f4db16-4441-488f-b5cb-0c3fb1cfa18b\" (UID: \"09f4db16-4441-488f-b5cb-0c3fb1cfa18b\") "
Jul 24 19:29:32.470245 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:32.470218    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09f4db16-4441-488f-b5cb-0c3fb1cfa18b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "09f4db16-4441-488f-b5cb-0c3fb1cfa18b" (UID: "09f4db16-4441-488f-b5cb-0c3fb1cfa18b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:29:32.571497 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:32.571416    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09f4db16-4441-488f-b5cb-0c3fb1cfa18b-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:33.281044 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:33.281012    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr"
Jul 24 19:29:33.281248 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:33.281014    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr" event={"ID":"09f4db16-4441-488f-b5cb-0c3fb1cfa18b","Type":"ContainerDied","Data":"03d7df1d7d5a3a3f3f0b434d057fd392d62b737596b5869ec9854a6a83c76109"}
Jul 24 19:29:33.281248 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:33.281142    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03d7df1d7d5a3a3f3f0b434d057fd392d62b737596b5869ec9854a6a83c76109"
Jul 24 19:29:34.513425 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.513402    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:29:34.589866 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.589774    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-data\") pod \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") "
Jul 24 19:29:34.589866 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.589819    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-token\") pod \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") "
Jul 24 19:29:34.589866 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.589849    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nf69\" (UniqueName: \"kubernetes.io/projected/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-kube-api-access-4nf69\") pod \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") "
Jul 24 19:29:34.590165 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.589877    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istiod-ca-cert\") pod \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") "
Jul 24 19:29:34.590165 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.589905    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-workload-socket\") pod \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") "
Jul 24 19:29:34.590165 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.589936    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-workload-certs\") pod \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") "
Jul 24 19:29:34.590165 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.589960    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-podinfo\") pod \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") "
Jul 24 19:29:34.590165 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.590016    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-credential-socket\") pod \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") "
Jul 24 19:29:34.590165 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.590048    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-envoy\") pod \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\" (UID: \"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4\") "
Jul 24 19:29:34.590514 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.590329    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" (UID: "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:29:34.590514 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.590345    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" (UID: "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:29:34.590514 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.590451    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" (UID: "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:29:34.590678 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.590575    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" (UID: "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:29:34.590742 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.590725    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-data" (OuterVolumeSpecName: "istio-data") pod "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" (UID: "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:29:34.592262 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.592239    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-token" (OuterVolumeSpecName: "istio-token") pod "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" (UID: "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:29:34.592391 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.592287    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-kube-api-access-4nf69" (OuterVolumeSpecName: "kube-api-access-4nf69") pod "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" (UID: "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4"). InnerVolumeSpecName "kube-api-access-4nf69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:29:34.592443 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.592392    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" (UID: "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:29:34.592527 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.592508    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" (UID: "5eab5c8b-261c-4b18-a10d-284ff0fe2eb4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:29:34.691707 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.691673    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-workload-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:34.691707 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.691704    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-workload-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:34.691707 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.691716    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-podinfo\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:34.691947 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.691728    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-credential-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:34.691947 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.691740    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-envoy\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:34.691947 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.691750    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-data\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:34.691947 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.691760    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istio-token\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:34.691947 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.691771    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nf69\" (UniqueName: \"kubernetes.io/projected/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-kube-api-access-4nf69\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:34.691947 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:34.691783    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4-istiod-ca-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:35.293263 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:35.293228    2557 generic.go:356] "Generic (PLEG): container finished" podID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerID="89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17" exitCode=0
Jul 24 19:29:35.293467 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:35.293269    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" event={"ID":"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4","Type":"ContainerDied","Data":"89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17"}
Jul 24 19:29:35.293467 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:35.293288    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"
Jul 24 19:29:35.293467 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:35.293312    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k" event={"ID":"5eab5c8b-261c-4b18-a10d-284ff0fe2eb4","Type":"ContainerDied","Data":"6cb6c3a2af971f96723b7dc5bb4ba0ec3e1178db8df5d8bfcc9658fe24e0d40a"}
Jul 24 19:29:35.293467 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:35.293334    2557 scope.go:117] "RemoveContainer" containerID="89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17"
Jul 24 19:29:35.302746 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:35.302724    2557 scope.go:117] "RemoveContainer" containerID="63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9"
Jul 24 19:29:35.311162 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:35.311139    2557 scope.go:117] "RemoveContainer" containerID="89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17"
Jul 24 19:29:35.311262 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:35.311247    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"]
Jul 24 19:29:35.311474 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:29:35.311450    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17\": container with ID starting with 89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17 not found: ID does not exist" containerID="89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17"
Jul 24 19:29:35.311545 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:35.311486    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17"} err="failed to get container status \"89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17\": rpc error: code = NotFound desc = could not find container \"89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17\": container with ID starting with 89d9c7ba29a3a188a6286565dfe3572b1da2bfce0579e8206dd67bd1265b9a17 not found: ID does not exist"
Jul 24 19:29:35.311545 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:35.311510    2557 scope.go:117] "RemoveContainer" containerID="63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9"
Jul 24 19:29:35.311742 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:29:35.311725    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9\": container with ID starting with 63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9 not found: ID does not exist" containerID="63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9"
Jul 24 19:29:35.311785 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:35.311747    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9"} err="failed to get container status \"63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9\": rpc error: code = NotFound desc = could not find container \"63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9\": container with ID starting with 63fc397e60085c63f5a1a747ebf3b91705832444aa73786b4a873cbdee8eb9c9 not found: ID does not exist"
Jul 24 19:29:35.315004 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:35.314982    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-2d5d53-openshift-default-7cf9bc4656-mdv9k"]
Jul 24 19:29:36.622092 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:36.622049    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" path="/var/lib/kubelet/pods/5eab5c8b-261c-4b18-a10d-284ff0fe2eb4/volumes"
Jul 24 19:29:40.271434 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:40.271394    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:40.376492 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:40.376455    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:40.473869 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:40.473830    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:43.434274 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:43.434229    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:29:44.703218 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:44.703180    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:44.703709 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:44.703686    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr"]
Jul 24 19:29:44.706495 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:44.706466    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8a409a-q8vjr"]
Jul 24 19:29:45.080798 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:45.080765    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:46.621609 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:46.621580    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09f4db16-4441-488f-b5cb-0c3fb1cfa18b" path="/var/lib/kubelet/pods/09f4db16-4441-488f-b5cb-0c3fb1cfa18b/volumes"
Jul 24 19:29:51.099112 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:51.099063    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:51.172158 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:51.172126    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:51.333816 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:51.333777    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"]
Jul 24 19:29:51.334028 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:51.333991    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy" containerID="cri-o://d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb" gracePeriod=30
Jul 24 19:29:51.358495 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:51.358399    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:51.604816 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:51.604782    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:55.105543 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:55.105500    2557 patch_prober.go:28] interesting pod/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:29:55.105945 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:55.105572    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:29:56.593618 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.593545    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:29:56.790188 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.790144    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-podinfo\") pod \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") "
Jul 24 19:29:56.790188 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.790194    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-credential-socket\") pod \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") "
Jul 24 19:29:56.790511 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.790232    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5j7h\" (UniqueName: \"kubernetes.io/projected/d5eac499-792c-48a9-a15c-e741e0bbaa8f-kube-api-access-j5j7h\") pod \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") "
Jul 24 19:29:56.790511 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.790301    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-envoy\") pod \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") "
Jul 24 19:29:56.790511 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.790366    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istiod-ca-cert\") pod \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") "
Jul 24 19:29:56.790685 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.790518    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-workload-socket\") pod \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") "
Jul 24 19:29:56.790685 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.790573    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-token\") pod \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") "
Jul 24 19:29:56.790685 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.790566    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d5eac499-792c-48a9-a15c-e741e0bbaa8f" (UID: "d5eac499-792c-48a9-a15c-e741e0bbaa8f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:29:56.790685 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.790606    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-workload-certs\") pod \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") "
Jul 24 19:29:56.790685 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.790658    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-data\") pod \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\" (UID: \"d5eac499-792c-48a9-a15c-e741e0bbaa8f\") "
Jul 24 19:29:56.790952 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.790823    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d5eac499-792c-48a9-a15c-e741e0bbaa8f" (UID: "d5eac499-792c-48a9-a15c-e741e0bbaa8f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:29:56.791028 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.791006    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d5eac499-792c-48a9-a15c-e741e0bbaa8f" (UID: "d5eac499-792c-48a9-a15c-e741e0bbaa8f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:29:56.791094 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.791027    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d5eac499-792c-48a9-a15c-e741e0bbaa8f" (UID: "d5eac499-792c-48a9-a15c-e741e0bbaa8f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:29:56.791424 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.791398    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istiod-ca-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:56.791492 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.791429    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-workload-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:56.791492 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.791443    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-workload-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:56.791492 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.791457    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-credential-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:56.791688 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.791661    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-data" (OuterVolumeSpecName: "istio-data") pod "d5eac499-792c-48a9-a15c-e741e0bbaa8f" (UID: "d5eac499-792c-48a9-a15c-e741e0bbaa8f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:29:56.792879 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.792849    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5eac499-792c-48a9-a15c-e741e0bbaa8f-kube-api-access-j5j7h" (OuterVolumeSpecName: "kube-api-access-j5j7h") pod "d5eac499-792c-48a9-a15c-e741e0bbaa8f" (UID: "d5eac499-792c-48a9-a15c-e741e0bbaa8f"). InnerVolumeSpecName "kube-api-access-j5j7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:29:56.793034 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.793010    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d5eac499-792c-48a9-a15c-e741e0bbaa8f" (UID: "d5eac499-792c-48a9-a15c-e741e0bbaa8f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:29:56.793110 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.793011    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d5eac499-792c-48a9-a15c-e741e0bbaa8f" (UID: "d5eac499-792c-48a9-a15c-e741e0bbaa8f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:29:56.793398 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.793356    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5eac499-792c-48a9-a15c-e741e0bbaa8f" (UID: "d5eac499-792c-48a9-a15c-e741e0bbaa8f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:29:56.892271 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.892176    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-envoy\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:56.892271 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.892211    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-token\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:56.892271 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.892220    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-data\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:56.892271 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.892228    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5eac499-792c-48a9-a15c-e741e0bbaa8f-istio-podinfo\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:56.892271 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:56.892237    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5j7h\" (UniqueName: \"kubernetes.io/projected/d5eac499-792c-48a9-a15c-e741e0bbaa8f-kube-api-access-j5j7h\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:29:57.406710 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:57.406671    2557 generic.go:356] "Generic (PLEG): container finished" podID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerID="d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb" exitCode=0
Jul 24 19:29:57.406884 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:57.406721    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"
Jul 24 19:29:57.406884 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:57.406758    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" event={"ID":"d5eac499-792c-48a9-a15c-e741e0bbaa8f","Type":"ContainerDied","Data":"d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb"}
Jul 24 19:29:57.406884 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:57.406818    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28" event={"ID":"d5eac499-792c-48a9-a15c-e741e0bbaa8f","Type":"ContainerDied","Data":"8fa982fb9b746c43cdcf0a17c1a1eb285e5941185262bb17e7f7e485869a9463"}
Jul 24 19:29:57.406884 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:57.406847    2557 scope.go:117] "RemoveContainer" containerID="d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb"
Jul 24 19:29:57.416176 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:57.416158    2557 scope.go:117] "RemoveContainer" containerID="408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab"
Jul 24 19:29:57.423844 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:57.423829    2557 scope.go:117] "RemoveContainer" containerID="d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb"
Jul 24 19:29:57.424083 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:29:57.424063    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb\": container with ID starting with d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb not found: ID does not exist" containerID="d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb"
Jul 24 19:29:57.424132 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:57.424091    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb"} err="failed to get container status \"d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb\": rpc error: code = NotFound desc = could not find container \"d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb\": container with ID starting with d0dc04ec4dbcad28febb6c2a72e0ad2cc97def9e39c6de6868fecd64a41a1beb not found: ID does not exist"
Jul 24 19:29:57.424132 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:57.424109    2557 scope.go:117] "RemoveContainer" containerID="408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab"
Jul 24 19:29:57.424336 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:29:57.424320    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab\": container with ID starting with 408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab not found: ID does not exist" containerID="408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab"
Jul 24 19:29:57.424403 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:57.424344    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab"} err="failed to get container status \"408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab\": rpc error: code = NotFound desc = could not find container \"408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab\": container with ID starting with 408418b63b7b783ccdb02fc14e480e78812bba62358b8ad5883cc6604aff01ab not found: ID does not exist"
Jul 24 19:29:57.428978 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:57.428956    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"]
Jul 24 19:29:57.433146 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:57.433125    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-8a409a-openshift-default-866c6bf67d-jqk28"]
Jul 24 19:29:58.622567 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:29:58.622538    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" path="/var/lib/kubelet/pods/d5eac499-792c-48a9-a15c-e741e0bbaa8f/volumes"
Jul 24 19:30:00.147325 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.147290    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748690-9ckwd"]
Jul 24 19:30:00.147729 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.147648    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerName="istio-proxy"
Jul 24 19:30:00.147729 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.147660    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerName="istio-proxy"
Jul 24 19:30:00.147729 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.147674    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy"
Jul 24 19:30:00.147729 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.147679    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy"
Jul 24 19:30:00.147729 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.147687    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09f4db16-4441-488f-b5cb-0c3fb1cfa18b" containerName="revoke-keys"
Jul 24 19:30:00.147729 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.147693    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="09f4db16-4441-488f-b5cb-0c3fb1cfa18b" containerName="revoke-keys"
Jul 24 19:30:00.147924 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.147757    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy"
Jul 24 19:30:00.147924 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.147765    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy"
Jul 24 19:30:00.147924 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.147774    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerName="istio-proxy"
Jul 24 19:30:00.147924 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.147780    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="09f4db16-4441-488f-b5cb-0c3fb1cfa18b" containerName="revoke-keys"
Jul 24 19:30:00.147924 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.147785    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerName="istio-proxy"
Jul 24 19:30:00.152142 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.152120    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748690-9ckwd"
Jul 24 19:30:00.153062 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.153038    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv"]
Jul 24 19:30:00.153561 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.153544    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerName="istio-proxy"
Jul 24 19:30:00.153618 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.153566    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eab5c8b-261c-4b18-a10d-284ff0fe2eb4" containerName="istio-proxy"
Jul 24 19:30:00.153618 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.153586    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy"
Jul 24 19:30:00.153618 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.153594    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5eac499-792c-48a9-a15c-e741e0bbaa8f" containerName="istio-proxy"
Jul 24 19:30:00.155241 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.155225    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:30:00.156815 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.156799    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d391c5-29748690-77fxf"]
Jul 24 19:30:00.156914 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.156900    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv"
Jul 24 19:30:00.159940 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.159921    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d391c5-29748690-77fxf"
Jul 24 19:30:00.162933 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.162916    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748690-9ckwd"
Jul 24 19:30:00.166135 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.166044    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748690-9ckwd"]
Jul 24 19:30:00.170759 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.170731    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv"]
Jul 24 19:30:00.174118 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.174089    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv"
Jul 24 19:30:00.189848 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.189787    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d391c5-29748690-77fxf"]
Jul 24 19:30:00.212646 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.212578    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d391c5-29748690-77fxf"
Jul 24 19:30:00.344465 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.344434    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748690-9ckwd"]
Jul 24 19:30:00.346989 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:30:00.346931    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e58a8e_ae3a_4957_a1ff_5c73a38d8d82.slice/crio-5a094a8ae37433921494877950e82343a9596f4dfa2acbab9988e5f1949c2efb WatchSource:0}: Error finding container 5a094a8ae37433921494877950e82343a9596f4dfa2acbab9988e5f1949c2efb: Status 404 returned error can't find the container with id 5a094a8ae37433921494877950e82343a9596f4dfa2acbab9988e5f1949c2efb
Jul 24 19:30:00.406072 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.406044    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d391c5-29748690-77fxf"]
Jul 24 19:30:00.411505 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:30:00.411481    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59854d79_7ad6_48b4_9d38_e225785b1bde.slice/crio-11510bddd6de92dc9919975d217a3fd845e551c9975a4370727d7c398da51b4b WatchSource:0}: Error finding container 11510bddd6de92dc9919975d217a3fd845e551c9975a4370727d7c398da51b4b: Status 404 returned error can't find the container with id 11510bddd6de92dc9919975d217a3fd845e551c9975a4370727d7c398da51b4b
Jul 24 19:30:00.427064 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.427027    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d391c5-29748690-77fxf" event={"ID":"59854d79-7ad6-48b4-9d38-e225785b1bde","Type":"ContainerStarted","Data":"11510bddd6de92dc9919975d217a3fd845e551c9975a4370727d7c398da51b4b"}
Jul 24 19:30:00.428240 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.428213    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748690-9ckwd" event={"ID":"c9e58a8e-ae3a-4957-a1ff-5c73a38d8d82","Type":"ContainerStarted","Data":"5a094a8ae37433921494877950e82343a9596f4dfa2acbab9988e5f1949c2efb"}
Jul 24 19:30:00.581811 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:00.581780    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv"]
Jul 24 19:30:00.584230 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:30:00.584194    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf747b53_1e5f_47a8_a0a6_da35062c9ed2.slice/crio-0cddfeadbba0d3b82b70886986716115dacdf181ee17dd42ac3f6e20662fed6d WatchSource:0}: Error finding container 0cddfeadbba0d3b82b70886986716115dacdf181ee17dd42ac3f6e20662fed6d: Status 404 returned error can't find the container with id 0cddfeadbba0d3b82b70886986716115dacdf181ee17dd42ac3f6e20662fed6d
Jul 24 19:30:01.435295 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:01.435261    2557 generic.go:356] "Generic (PLEG): container finished" podID="c9e58a8e-ae3a-4957-a1ff-5c73a38d8d82" containerID="89451c9f44caddb19615271f9098104cb0df02100597df9829f086eb2910c906" exitCode=0
Jul 24 19:30:01.435767 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:01.435351    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748690-9ckwd" event={"ID":"c9e58a8e-ae3a-4957-a1ff-5c73a38d8d82","Type":"ContainerDied","Data":"89451c9f44caddb19615271f9098104cb0df02100597df9829f086eb2910c906"}
Jul 24 19:30:01.436952 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:01.436924    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv" event={"ID":"af747b53-1e5f-47a8-a0a6-da35062c9ed2","Type":"ContainerStarted","Data":"15c8c3eb71ecdc7bdf547b6de7b32ffeaadc5caadc90bca0e7d6f0d3251f20e6"}
Jul 24 19:30:01.437110 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:01.436970    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv" event={"ID":"af747b53-1e5f-47a8-a0a6-da35062c9ed2","Type":"ContainerStarted","Data":"0cddfeadbba0d3b82b70886986716115dacdf181ee17dd42ac3f6e20662fed6d"}
Jul 24 19:30:01.438363 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:01.438343    2557 generic.go:356] "Generic (PLEG): container finished" podID="59854d79-7ad6-48b4-9d38-e225785b1bde" containerID="9d185bd4253ca8803af388f3114bbee40ab7e7a6e90e5af8c18f6da837307326" exitCode=0
Jul 24 19:30:01.438497 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:01.438399    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d391c5-29748690-77fxf" event={"ID":"59854d79-7ad6-48b4-9d38-e225785b1bde","Type":"ContainerDied","Data":"9d185bd4253ca8803af388f3114bbee40ab7e7a6e90e5af8c18f6da837307326"}
Jul 24 19:30:01.480634 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:01.480574    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv" podStartSLOduration=1.480559283 podStartE2EDuration="1.480559283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:30:01.478233903 +0000 UTC m=+2989.403186498" watchObservedRunningTime="2026-07-24 19:30:01.480559283 +0000 UTC m=+2989.405511856"
Jul 24 19:30:02.352100 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:02.352060    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv"]
Jul 24 19:30:02.364771 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:02.364739    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:02.446488 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:02.446452    2557 generic.go:356] "Generic (PLEG): container finished" podID="af747b53-1e5f-47a8-a0a6-da35062c9ed2" containerID="15c8c3eb71ecdc7bdf547b6de7b32ffeaadc5caadc90bca0e7d6f0d3251f20e6" exitCode=0
Jul 24 19:30:02.446903 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:02.446538    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv" event={"ID":"af747b53-1e5f-47a8-a0a6-da35062c9ed2","Type":"ContainerDied","Data":"15c8c3eb71ecdc7bdf547b6de7b32ffeaadc5caadc90bca0e7d6f0d3251f20e6"}
Jul 24 19:30:02.529073 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:02.528706    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:02.583591 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:02.583536    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:02.593982 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:02.593953    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d391c5-29748690-77fxf"
Jul 24 19:30:02.636060 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:02.636035    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748690-9ckwd"
Jul 24 19:30:03.452711 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:03.452684    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d391c5-29748690-77fxf"
Jul 24 19:30:03.453142 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:03.452725    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d391c5-29748690-77fxf" event={"ID":"59854d79-7ad6-48b4-9d38-e225785b1bde","Type":"ContainerDied","Data":"11510bddd6de92dc9919975d217a3fd845e551c9975a4370727d7c398da51b4b"}
Jul 24 19:30:03.453142 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:03.452776    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11510bddd6de92dc9919975d217a3fd845e551c9975a4370727d7c398da51b4b"
Jul 24 19:30:03.454080 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:03.454051    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748690-9ckwd" event={"ID":"c9e58a8e-ae3a-4957-a1ff-5c73a38d8d82","Type":"ContainerDied","Data":"5a094a8ae37433921494877950e82343a9596f4dfa2acbab9988e5f1949c2efb"}
Jul 24 19:30:03.454080 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:03.454073    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748690-9ckwd"
Jul 24 19:30:03.454290 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:03.454101    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a094a8ae37433921494877950e82343a9596f4dfa2acbab9988e5f1949c2efb"
Jul 24 19:30:03.588567 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:03.588539    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv"
Jul 24 19:30:04.460994 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:04.460960    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv"
Jul 24 19:30:04.461443 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:04.460997    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv" event={"ID":"af747b53-1e5f-47a8-a0a6-da35062c9ed2","Type":"ContainerDied","Data":"0cddfeadbba0d3b82b70886986716115dacdf181ee17dd42ac3f6e20662fed6d"}
Jul 24 19:30:04.461443 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:04.461074    2557 scope.go:117] "RemoveContainer" containerID="15c8c3eb71ecdc7bdf547b6de7b32ffeaadc5caadc90bca0e7d6f0d3251f20e6"
Jul 24 19:30:04.482709 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:04.482681    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv"]
Jul 24 19:30:04.486858 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:04.486834    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-65184f-29748690-wmhmv"]
Jul 24 19:30:04.621620 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:04.621583    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af747b53-1e5f-47a8-a0a6-da35062c9ed2" path="/var/lib/kubelet/pods/af747b53-1e5f-47a8-a0a6-da35062c9ed2/volumes"
Jul 24 19:30:05.324148 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:05.324113    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:30:06.860452 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:06.860418    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:07.259741 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:07.259708    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:13.440556 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:13.440473    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:13.513013 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:13.512981    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:13.670673 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:13.670630    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"]
Jul 24 19:30:13.670909 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:13.670868    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" podUID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerName="istio-proxy" containerID="cri-o://44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e" gracePeriod=30
Jul 24 19:30:13.690339 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:13.690308    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:13.915153 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:13.915119    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:14.026560 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.026516    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w"]
Jul 24 19:30:14.027129 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.027108    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9e58a8e-ae3a-4957-a1ff-5c73a38d8d82" containerName="cleanup"
Jul 24 19:30:14.027175 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.027133    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9e58a8e-ae3a-4957-a1ff-5c73a38d8d82" containerName="cleanup"
Jul 24 19:30:14.027175 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.027149    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af747b53-1e5f-47a8-a0a6-da35062c9ed2" containerName="cleanup"
Jul 24 19:30:14.027175 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.027157    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="af747b53-1e5f-47a8-a0a6-da35062c9ed2" containerName="cleanup"
Jul 24 19:30:14.027274 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.027174    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59854d79-7ad6-48b4-9d38-e225785b1bde" containerName="cleanup"
Jul 24 19:30:14.027274 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.027184    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="59854d79-7ad6-48b4-9d38-e225785b1bde" containerName="cleanup"
Jul 24 19:30:14.027274 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.027265    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9e58a8e-ae3a-4957-a1ff-5c73a38d8d82" containerName="cleanup"
Jul 24 19:30:14.027488 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.027276    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="59854d79-7ad6-48b4-9d38-e225785b1bde" containerName="cleanup"
Jul 24 19:30:14.027488 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.027282    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="af747b53-1e5f-47a8-a0a6-da35062c9ed2" containerName="cleanup"
Jul 24 19:30:14.031836 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.031810    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w"
Jul 24 19:30:14.035064 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.035033    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:30:14.035314 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.035294    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:30:14.036760 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.036734    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w"]
Jul 24 19:30:14.144390 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.144347    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d124594-91f8-4b1b-a44c-31c5c5a38262-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w\" (UID: \"1d124594-91f8-4b1b-a44c-31c5c5a38262\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w"
Jul 24 19:30:14.245584 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.245547    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d124594-91f8-4b1b-a44c-31c5c5a38262-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w\" (UID: \"1d124594-91f8-4b1b-a44c-31c5c5a38262\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w"
Jul 24 19:30:14.246169 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.246147    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d124594-91f8-4b1b-a44c-31c5c5a38262-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w\" (UID: \"1d124594-91f8-4b1b-a44c-31c5c5a38262\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w"
Jul 24 19:30:14.345292 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.345253    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w"
Jul 24 19:30:14.486466 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.486428    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w"]
Jul 24 19:30:14.489997 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:30:14.489968    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d124594_91f8_4b1b_a44c_31c5c5a38262.slice/crio-51298a7da541de6272e26027d8365b27c244930119fc102e9e302617f4514bb0 WatchSource:0}: Error finding container 51298a7da541de6272e26027d8365b27c244930119fc102e9e302617f4514bb0: Status 404 returned error can't find the container with id 51298a7da541de6272e26027d8365b27c244930119fc102e9e302617f4514bb0
Jul 24 19:30:14.519629 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.519601    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w" event={"ID":"1d124594-91f8-4b1b-a44c-31c5c5a38262","Type":"ContainerStarted","Data":"51298a7da541de6272e26027d8365b27c244930119fc102e9e302617f4514bb0"}
Jul 24 19:30:14.889865 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.889827    2557 patch_prober.go:28] interesting pod/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:30:14.890044 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:14.889883    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" podUID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:30:15.526840 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:15.526805    2557 generic.go:356] "Generic (PLEG): container finished" podID="1d124594-91f8-4b1b-a44c-31c5c5a38262" containerID="6bcb7aeffd5cdbf8e06cdd3b1a559a63fd1cefbc486cea31a92afc7f9cf46428" exitCode=0
Jul 24 19:30:15.527236 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:15.526878    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w" event={"ID":"1d124594-91f8-4b1b-a44c-31c5c5a38262","Type":"ContainerDied","Data":"6bcb7aeffd5cdbf8e06cdd3b1a559a63fd1cefbc486cea31a92afc7f9cf46428"}
Jul 24 19:30:16.667704 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:16.667678    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w"
Jul 24 19:30:16.770121 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:16.770088    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d124594-91f8-4b1b-a44c-31c5c5a38262-maas-api-service-ca\") pod \"1d124594-91f8-4b1b-a44c-31c5c5a38262\" (UID: \"1d124594-91f8-4b1b-a44c-31c5c5a38262\") "
Jul 24 19:30:16.770504 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:16.770483    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d124594-91f8-4b1b-a44c-31c5c5a38262-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1d124594-91f8-4b1b-a44c-31c5c5a38262" (UID: "1d124594-91f8-4b1b-a44c-31c5c5a38262"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:30:16.871061 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:16.870970    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d124594-91f8-4b1b-a44c-31c5c5a38262-maas-api-service-ca\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:30:17.538465 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:17.538435    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w"
Jul 24 19:30:17.538660 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:17.538430    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w" event={"ID":"1d124594-91f8-4b1b-a44c-31c5c5a38262","Type":"ContainerDied","Data":"51298a7da541de6272e26027d8365b27c244930119fc102e9e302617f4514bb0"}
Jul 24 19:30:17.538660 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:17.538566    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51298a7da541de6272e26027d8365b27c244930119fc102e9e302617f4514bb0"
Jul 24 19:30:18.926681 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.926654    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:30:18.990294 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990261    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istiod-ca-cert\") pod \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") "
Jul 24 19:30:18.990294 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990298    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-podinfo\") pod \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") "
Jul 24 19:30:18.990578 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990319    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-token\") pod \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") "
Jul 24 19:30:18.990578 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990354    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-workload-certs\") pod \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") "
Jul 24 19:30:18.990578 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990430    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tksw\" (UniqueName: \"kubernetes.io/projected/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-kube-api-access-7tksw\") pod \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") "
Jul 24 19:30:18.990578 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990518    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-credential-socket\") pod \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") "
Jul 24 19:30:18.990578 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990562    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-data\") pod \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") "
Jul 24 19:30:18.990874 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990585    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-workload-socket\") pod \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") "
Jul 24 19:30:18.990874 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990612    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-envoy\") pod \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\" (UID: \"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f\") "
Jul 24 19:30:18.990874 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990645    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" (UID: "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:18.990874 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990831    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" (UID: "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:30:18.990874 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990852    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" (UID: "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:18.991120 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.990981    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-workload-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:30:18.991120 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.991001    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istiod-ca-cert\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:30:18.991120 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.991016    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-workload-certs\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:30:18.991417 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.991389    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" (UID: "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:18.991658 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.991630    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-data" (OuterVolumeSpecName: "istio-data") pod "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" (UID: "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:18.993012 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.992990    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-token" (OuterVolumeSpecName: "istio-token") pod "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" (UID: "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:30:18.993214 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.993185    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" (UID: "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:18.993331 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.993312    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-kube-api-access-7tksw" (OuterVolumeSpecName: "kube-api-access-7tksw") pod "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" (UID: "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f"). InnerVolumeSpecName "kube-api-access-7tksw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:30:18.993423 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:18.993366    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" (UID: "af72f3c2-ce27-4eb9-84d7-47e0f6fe286f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:30:19.091765 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.091730    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-data\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:30:19.091765 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.091757    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-envoy\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:30:19.091765 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.091766    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-podinfo\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:30:19.092008 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.091774    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-istio-token\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:30:19.092008 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.091786    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tksw\" (UniqueName: \"kubernetes.io/projected/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-kube-api-access-7tksw\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:30:19.092008 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.091794    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f-credential-socket\") on node \"ip-10-0-141-149.ec2.internal\" DevicePath \"\""
Jul 24 19:30:19.549942 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.549898    2557 generic.go:356] "Generic (PLEG): container finished" podID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerID="44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e" exitCode=0
Jul 24 19:30:19.550114 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.549950    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"
Jul 24 19:30:19.550114 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.549981    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" event={"ID":"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f","Type":"ContainerDied","Data":"44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e"}
Jul 24 19:30:19.550114 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.550039    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27" event={"ID":"af72f3c2-ce27-4eb9-84d7-47e0f6fe286f","Type":"ContainerDied","Data":"8d90cebf7e8605f1e30e021fc09fac5b4deab54b9e1c4f2885c50c228c119f79"}
Jul 24 19:30:19.550114 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.550062    2557 scope.go:117] "RemoveContainer" containerID="44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e"
Jul 24 19:30:19.562287 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.562266    2557 scope.go:117] "RemoveContainer" containerID="0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757"
Jul 24 19:30:19.570720 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.570702    2557 scope.go:117] "RemoveContainer" containerID="44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e"
Jul 24 19:30:19.570970 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:30:19.570949    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e\": container with ID starting with 44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e not found: ID does not exist" containerID="44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e"
Jul 24 19:30:19.571034 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.570977    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e"} err="failed to get container status \"44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e\": rpc error: code = NotFound desc = could not find container \"44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e\": container with ID starting with 44e32576bd365c7170c52b9bc62c554018c3fa84d484b3d079fb5548deb8512e not found: ID does not exist"
Jul 24 19:30:19.571034 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.570992    2557 scope.go:117] "RemoveContainer" containerID="0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757"
Jul 24 19:30:19.571203 ip-10-0-141-149 kubenswrapper[2557]: E0724 19:30:19.571188    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757\": container with ID starting with 0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757 not found: ID does not exist" containerID="0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757"
Jul 24 19:30:19.571240 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.571207    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757"} err="failed to get container status \"0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757\": rpc error: code = NotFound desc = could not find container \"0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757\": container with ID starting with 0420b41589ccc0ec774ae1537e24fc56d1b3575e363ec5a277edc12f6157a757 not found: ID does not exist"
Jul 24 19:30:19.585667 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.585635    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"]
Jul 24 19:30:19.591632 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:19.591605    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-65184f-openshift-default-546fc96b76-fng27"]
Jul 24 19:30:20.621860 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:20.621829    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" path="/var/lib/kubelet/pods/af72f3c2-ce27-4eb9-84d7-47e0f6fe286f/volumes"
Jul 24 19:30:25.382220 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:25.382186    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:25.383406 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:25.383355    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d391c5-29748690-77fxf"]
Jul 24 19:30:25.385097 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:25.385075    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d391c5-29748690-77fxf"]
Jul 24 19:30:25.450631 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:25.450588    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:25.506713 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:25.506683    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:26.622092 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:26.622056    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59854d79-7ad6-48b4-9d38-e225785b1bde" path="/var/lib/kubelet/pods/59854d79-7ad6-48b4-9d38-e225785b1bde/volumes"
Jul 24 19:30:28.221496 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:28.221457    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9dht7"]
Jul 24 19:30:29.197159 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:29.197116    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:29.208456 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:29.208422    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w"]
Jul 24 19:30:29.210536 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:29.210510    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d391c5-dkd4w"]
Jul 24 19:30:29.574547 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:29.574512    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:30.622321 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:30.622290    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d124594-91f8-4b1b-a44c-31c5c5a38262" path="/var/lib/kubelet/pods/1d124594-91f8-4b1b-a44c-31c5c5a38262/volumes"
Jul 24 19:30:35.652262 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:35.652227    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:35.752937 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:35.752875    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:35.926067 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:35.925977    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:36.133837 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:36.133797    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:41.820451 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:41.820419    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gt6qt_03b3db37-bd43-409a-ace0-8f83bfcc9e17/manager/0.log"
Jul 24 19:30:41.941100 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:41.941069    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5jvqv_479b93f7-6bbf-4e3b-b4da-c12eda03937b/manager/0.log"
Jul 24 19:30:42.197085 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:42.197000    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ct8jj_8009cf55-e775-4149-b7ba-0033f1951ad8/server/0.log"
Jul 24 19:30:42.312217 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:42.312184    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rd4zm_c0cfb807-0130-4b06-8cbc-b769b5b6a49c/manager/0.log"
Jul 24 19:30:42.428532 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:42.428501    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859dddff6f-2mmwz_4ba652a1-f452-45ec-a39c-ef023be1771d/copy-manifests/0.log"
Jul 24 19:30:42.436473 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:42.436441    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859dddff6f-2mmwz_4ba652a1-f452-45ec-a39c-ef023be1771d/manager/0.log"
Jul 24 19:30:43.246161 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:43.246128    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748675-25chd_5778dd59-5d08-4bb0-b32a-b623e01b5876/cleanup/0.log"
Jul 24 19:30:43.363036 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:43.362996    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748690-9ckwd_c9e58a8e-ae3a-4957-a1ff-5c73a38d8d82/cleanup/0.log"
Jul 24 19:30:45.433749 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:45.433716    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9dht7_c0a49ac0-4daa-4451-b83d-d50880227015/limitador/0.log"
Jul 24 19:30:45.553093 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:45.553060    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-k2j8z_8eb25bec-7c4a-4a45-9246-62236e6fdb8d/manager/0.log"
Jul 24 19:30:46.017103 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:46.017072    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bb958_e831d732-d63f-402d-8674-958bb2e2d14c/discovery/0.log"
Jul 24 19:30:46.236937 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:46.236890    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bbbd7cd9b-f6c88_05d5ed6c-ce16-4a91-b1fb-02b609d191c4/kube-auth-proxy/0.log"
Jul 24 19:30:47.377733 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:47.377699    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2jqdd_de13232d-f2b1-47ea-9b64-a0dcbcac5bfe/main/0.log"
Jul 24 19:30:53.241314 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:53.241274    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:53.308640 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:53.308606    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:55.959708 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:55.959670    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:56.060744 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:56.060707    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:56.128988 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:56.128957    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ms8c7_49c8a3c7-ccf6-48e8-9df2-4b2621742cbd/global-pull-secret-syncer/0.log"
Jul 24 19:30:56.223047 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:56.222958    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log"
Jul 24 19:30:56.379627 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:30:56.379593    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-149.ec2.internal_9603afaddd1d6ed200ec863aca53bb00/haproxy/0.log"
Jul 24 19:31:01.300632 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:01.300600    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9dht7_c0a49ac0-4daa-4451-b83d-d50880227015/limitador/0.log"
Jul 24 19:31:01.367995 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:01.367954    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-k2j8z_8eb25bec-7c4a-4a45-9246-62236e6fdb8d/manager/0.log"
Jul 24 19:31:02.950462 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:02.950424    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ggwk_184fa814-8fa0-4d76-91ce-aa242fb35a0e/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:03.114282 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:03.114247    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-kdjz5_765f62ba-a979-469f-ad0d-bd7d2efa79d1/cluster-monitoring-operator/0.log"
Jul 24 19:31:03.291962 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:03.291930    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-4rwvx_461ee2ae-7831-4b75-92a3-5574435242ba/monitoring-plugin/0.log"
Jul 24 19:31:03.333833 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:03.333805    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4lfv2_1a87619b-d15f-4290-9485-7cac016374e2/node-exporter/0.log"
Jul 24 19:31:03.356407 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:03.356371    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4lfv2_1a87619b-d15f-4290-9485-7cac016374e2/kube-rbac-proxy/0.log"
Jul 24 19:31:03.378142 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:03.378117    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4lfv2_1a87619b-d15f-4290-9485-7cac016374e2/init-textfile/0.log"
Jul 24 19:31:03.896309 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:03.896193    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-b244n_b6843463-8e5e-418b-9529-a97dca2a3ffd/prometheus-operator-admission-webhook/0.log"
Jul 24 19:31:06.544671 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.544587    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"]
Jul 24 19:31:06.545041 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.544923    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerName="istio-proxy"
Jul 24 19:31:06.545041 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.544934    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerName="istio-proxy"
Jul 24 19:31:06.545041 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.544955    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d124594-91f8-4b1b-a44c-31c5c5a38262" containerName="revoke-keys"
Jul 24 19:31:06.545041 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.544961    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d124594-91f8-4b1b-a44c-31c5c5a38262" containerName="revoke-keys"
Jul 24 19:31:06.545041 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.545012    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerName="istio-proxy"
Jul 24 19:31:06.545041 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.545020    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="af72f3c2-ce27-4eb9-84d7-47e0f6fe286f" containerName="istio-proxy"
Jul 24 19:31:06.545041 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.545028    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d124594-91f8-4b1b-a44c-31c5c5a38262" containerName="revoke-keys"
Jul 24 19:31:06.548078 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.548061    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.550652 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.550595    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vd7mh\"/\"openshift-service-ca.crt\""
Jul 24 19:31:06.550810 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.550716    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vd7mh\"/\"kube-root-ca.crt\""
Jul 24 19:31:06.551471 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.551454    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vd7mh\"/\"default-dockercfg-xcq4b\""
Jul 24 19:31:06.556594 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.556571    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"]
Jul 24 19:31:06.557099 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.557084    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-dd9ffb44b-lmldv_bc4ca0a7-5d95-43f3-9b11-c39fecb9040a/console/0.log"
Jul 24 19:31:06.627832 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.627792    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91970279-4910-4302-b9fe-30ea3c3a5667-proc\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.628022 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.627841    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91970279-4910-4302-b9fe-30ea3c3a5667-lib-modules\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.628022 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.627861    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91970279-4910-4302-b9fe-30ea3c3a5667-sys\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.628022 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.627964    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgxjk\" (UniqueName: \"kubernetes.io/projected/91970279-4910-4302-b9fe-30ea3c3a5667-kube-api-access-mgxjk\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.628022 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.627982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91970279-4910-4302-b9fe-30ea3c3a5667-podres\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.729459 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.729421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgxjk\" (UniqueName: \"kubernetes.io/projected/91970279-4910-4302-b9fe-30ea3c3a5667-kube-api-access-mgxjk\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.729623 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.729483    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91970279-4910-4302-b9fe-30ea3c3a5667-podres\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.729623 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.729554    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91970279-4910-4302-b9fe-30ea3c3a5667-proc\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.729623 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.729598    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91970279-4910-4302-b9fe-30ea3c3a5667-lib-modules\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.729790 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.729630    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91970279-4910-4302-b9fe-30ea3c3a5667-sys\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.729790 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.729681    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91970279-4910-4302-b9fe-30ea3c3a5667-proc\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.729790 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.729683    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91970279-4910-4302-b9fe-30ea3c3a5667-podres\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.729790 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.729721    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91970279-4910-4302-b9fe-30ea3c3a5667-sys\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.729790 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.729769    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91970279-4910-4302-b9fe-30ea3c3a5667-lib-modules\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.737127 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.737102    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgxjk\" (UniqueName: \"kubernetes.io/projected/91970279-4910-4302-b9fe-30ea3c3a5667-kube-api-access-mgxjk\") pod \"perf-node-gather-daemonset-cxnj4\" (UID: \"91970279-4910-4302-b9fe-30ea3c3a5667\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.858997 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.858886    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:06.992834 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:06.992806    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"]
Jul 24 19:31:06.994800 ip-10-0-141-149 kubenswrapper[2557]: W0724 19:31:06.994772    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod91970279_4910_4302_b9fe_30ea3c3a5667.slice/crio-1160d037f690a937812d1983bc0bb6daf6d089c689ef50548b001845e8dd9630 WatchSource:0}: Error finding container 1160d037f690a937812d1983bc0bb6daf6d089c689ef50548b001845e8dd9630: Status 404 returned error can't find the container with id 1160d037f690a937812d1983bc0bb6daf6d089c689ef50548b001845e8dd9630
Jul 24 19:31:07.338054 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:07.338026    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-wgk7v_a138dba4-dc72-4648-b474-865744e31462/volume-data-source-validator/0.log"
Jul 24 19:31:07.793913 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:07.793878    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4" event={"ID":"91970279-4910-4302-b9fe-30ea3c3a5667","Type":"ContainerStarted","Data":"65f2d91993645a19a5447480ee618ae8010110f2bf5299c6cfae0d3ed26585a7"}
Jul 24 19:31:07.794306 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:07.793933    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4" event={"ID":"91970279-4910-4302-b9fe-30ea3c3a5667","Type":"ContainerStarted","Data":"1160d037f690a937812d1983bc0bb6daf6d089c689ef50548b001845e8dd9630"}
Jul 24 19:31:07.794306 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:07.794004    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:07.819328 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:07.819276    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4" podStartSLOduration=1.819259117 podStartE2EDuration="1.819259117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:31:07.817899814 +0000 UTC m=+3055.742852408" watchObservedRunningTime="2026-07-24 19:31:07.819259117 +0000 UTC m=+3055.744211728"
Jul 24 19:31:08.405117 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:08.405085    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fpk2x_7779c2fa-1f19-42a8-b4b9-9de711267983/dns/0.log"
Jul 24 19:31:08.439098 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:08.439056    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fpk2x_7779c2fa-1f19-42a8-b4b9-9de711267983/kube-rbac-proxy/0.log"
Jul 24 19:31:08.620095 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:08.620067    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gf7wk_6f9fb4e8-7a2d-44ae-a172-437960383a64/dns-node-resolver/0.log"
Jul 24 19:31:09.179711 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:09.179679    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-755b99fc9-p757p_7069d773-b7f5-4cf3-985b-4ae3f0740b62/registry/0.log"
Jul 24 19:31:09.200194 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:09.200167    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-54spr_f406878b-57b2-47b8-87f0-f682f054d494/node-ca/0.log"
Jul 24 19:31:10.307856 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:10.307824    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bb958_e831d732-d63f-402d-8674-958bb2e2d14c/discovery/0.log"
Jul 24 19:31:10.354010 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:10.353986    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bbbd7cd9b-f6c88_05d5ed6c-ce16-4a91-b1fb-02b609d191c4/kube-auth-proxy/0.log"
Jul 24 19:31:11.343721 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:11.343692    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gnms9_b555ed91-5652-45d6-ba0c-c07c6d2f9243/serve-healthcheck-canary/0.log"
Jul 24 19:31:11.831528 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:11.831493    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-k4875_90f2aede-506b-4d4f-95ce-551989d6fa89/insights-operator/0.log"
Jul 24 19:31:11.832060 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:11.832043    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-k4875_90f2aede-506b-4d4f-95ce-551989d6fa89/insights-operator/1.log"
Jul 24 19:31:11.983150 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:11.983121    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nml7m_6949c3ad-f467-45a2-8182-8c18079f4407/kube-rbac-proxy/0.log"
Jul 24 19:31:12.004368 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:12.004340    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nml7m_6949c3ad-f467-45a2-8182-8c18079f4407/exporter/0.log"
Jul 24 19:31:12.024828 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:12.024806    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nml7m_6949c3ad-f467-45a2-8182-8c18079f4407/extractor/0.log"
Jul 24 19:31:13.808435 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:13.808409    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-cxnj4"
Jul 24 19:31:14.070957 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:14.070859    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gt6qt_03b3db37-bd43-409a-ace0-8f83bfcc9e17/manager/0.log"
Jul 24 19:31:14.265708 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:14.265672    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5jvqv_479b93f7-6bbf-4e3b-b4da-c12eda03937b/manager/0.log"
Jul 24 19:31:14.512248 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:14.512222    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ct8jj_8009cf55-e775-4149-b7ba-0033f1951ad8/server/0.log"
Jul 24 19:31:14.581461 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:14.581425    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rd4zm_c0cfb807-0130-4b06-8cbc-b769b5b6a49c/manager/0.log"
Jul 24 19:31:14.604041 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:14.604014    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859dddff6f-2mmwz_4ba652a1-f452-45ec-a39c-ef023be1771d/manager/0.log"
Jul 24 19:31:14.626081 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:14.626052    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859dddff6f-2mmwz_4ba652a1-f452-45ec-a39c-ef023be1771d/copy-manifests/0.log"
Jul 24 19:31:16.527139 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:16.527056    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bb958_e831d732-d63f-402d-8674-958bb2e2d14c/discovery/0.log"
Jul 24 19:31:16.555493 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:16.555461    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bbbd7cd9b-f6c88_05d5ed6c-ce16-4a91-b1fb-02b609d191c4/kube-auth-proxy/0.log"
Jul 24 19:31:18.336738 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:18.336703    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bb958_e831d732-d63f-402d-8674-958bb2e2d14c/discovery/0.log"
Jul 24 19:31:18.368026 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:18.367996    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bbbd7cd9b-f6c88_05d5ed6c-ce16-4a91-b1fb-02b609d191c4/kube-auth-proxy/0.log"
Jul 24 19:31:22.875345 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:22.875313    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-92g8s_2bde3e8b-ad6d-4511-b005-247c8795a9d2/kube-multus/0.log"
Jul 24 19:31:23.238576 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:23.238546    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vn4mn_eae39ad6-5c21-4f9a-859f-1c142c64984d/kube-multus-additional-cni-plugins/0.log"
Jul 24 19:31:23.264205 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:23.264178    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vn4mn_eae39ad6-5c21-4f9a-859f-1c142c64984d/egress-router-binary-copy/0.log"
Jul 24 19:31:23.289599 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:23.289571    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vn4mn_eae39ad6-5c21-4f9a-859f-1c142c64984d/cni-plugins/0.log"
Jul 24 19:31:23.328794 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:23.328763    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vn4mn_eae39ad6-5c21-4f9a-859f-1c142c64984d/bond-cni-plugin/0.log"
Jul 24 19:31:23.348937 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:23.348914    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vn4mn_eae39ad6-5c21-4f9a-859f-1c142c64984d/routeoverride-cni/0.log"
Jul 24 19:31:23.368921 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:23.368895    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vn4mn_eae39ad6-5c21-4f9a-859f-1c142c64984d/whereabouts-cni-bincopy/0.log"
Jul 24 19:31:23.389726 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:23.389667    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vn4mn_eae39ad6-5c21-4f9a-859f-1c142c64984d/whereabouts-cni/0.log"
Jul 24 19:31:23.509317 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:23.509284    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-slqg5_251138c6-eb4c-4212-963c-dc993e074afc/network-metrics-daemon/0.log"
Jul 24 19:31:23.529095 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:23.529066    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-slqg5_251138c6-eb4c-4212-963c-dc993e074afc/kube-rbac-proxy/0.log"
Jul 24 19:31:24.402322 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:24.402290    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfctq_bdfabff3-effc-4bd5-9524-c81c39646750/ovn-controller/0.log"
Jul 24 19:31:24.417984 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:24.417959    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfctq_bdfabff3-effc-4bd5-9524-c81c39646750/ovn-acl-logging/0.log"
Jul 24 19:31:24.439976 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:24.439950    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfctq_bdfabff3-effc-4bd5-9524-c81c39646750/kube-rbac-proxy-node/0.log"
Jul 24 19:31:24.459688 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:24.459659    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfctq_bdfabff3-effc-4bd5-9524-c81c39646750/kube-rbac-proxy-ovn-metrics/0.log"
Jul 24 19:31:24.479205 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:24.479179    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfctq_bdfabff3-effc-4bd5-9524-c81c39646750/northd/0.log"
Jul 24 19:31:24.500961 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:24.500940    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfctq_bdfabff3-effc-4bd5-9524-c81c39646750/nbdb/0.log"
Jul 24 19:31:24.531135 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:24.531108    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfctq_bdfabff3-effc-4bd5-9524-c81c39646750/sbdb/0.log"
Jul 24 19:31:24.589743 ip-10-0-141-149 kubenswrapper[2557]: I0724 19:31:24.589716    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfctq_bdfabff3-effc-4bd5-9524-c81c39646750/ovnkube-controller/0.log"